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Abstract 


Theory of quantum games is a new area of investigation that has gone through rapid develop- 
ment during the last few years. Initial motivation for playing games, in the quantum world, 
‘comes from the possibility of re-formulating quantum communication protocols, and algorithms, 
in terms of games between quantum and classical players. The possibility led to the view that 
quantum games have a potential to provide helpful insight into working of quantum algorithms, 
and even in finding new ones. This thesis analyzes and compares some interesting games when. 
played classically and quantum mechanically. A large part of the thesis concerns investigations 
into a refinement notion of the Nash equilibrium concept. The refinement, called an evolt- 
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Chapter 1 


Introduction 


Game theory [1] is a branch of mathematics that presents formal analysis of the interaction 
among a group of rational players. The players have choices available to them, so as to select 
particular course of action. They are supposed to behave strategically and are motivated to 
increase their utilities that depend on the collective course of action. 

Modern game theory started with the work of John von Neumann and Oskar Morgenstern 
{2] in 1930s. During the same years von Neumann [3] also made important contributions in 
quantum mechanics, a branch of physics developed in 1920s to understand the microworld 
of atoms and molecules. However, game theory and quantum mechanics were developed as 
separate fields with apparently different domains of applications. 

The early years of development in both of these fields could not find some common ground, 
or physical situation, that could motivate an interplay between the two fields. More than fifty 
years afterwards, quantum computation (4, 5, 6, 7, 8, 9] was developed in 1980s as a new field 
of research that combined elements from quantum mechanics and the theory of computation 
[10]. Computer science extensively uses the theory of information and communication [11]. 
Quantum computation motivated the development of quantum information 12]; thus providing 
an environment where the two distinct interests of von Neumann, i.e. quantum mechanics and 
game theory, could be shown to have some sort of interplay. Certain quantum communication 
protocols, and algorithms, were reformulated in the language of game theory [13, 14, 15, 16, 17, 
18}. Tt was not long before the first systematic procedures {19, 20] were proposed to quantize 
well-known classical games [1 


Clssicl bits are the entities that ae used to physically implement clasical information, 
Quantum information 21], on the other hand, uses quantum bits (qubits) for its physical 


suggestion presents a set-up that uses the association of De Broglie waves with travelling mate- 
rial objects to play a quantum version of a two-player two-strategy game. The second suggestion 
uses an EPR type setting in which spatially separated players make measurements along chosen 
directions to play a game. 

‘The concluding chapter collects together main results obtained in the thesis. 


Chapter 2 
Elements of game theory 


2.1 Introduction 


Many decision making problems in sociology, politics and economics deal with situations in 
which the results depend not only on the action of one individual but also on the actions 
of others. Game theory is a branch of mathematics which is used in modelling situations in 
which many individuals with conflicting interests interact, such that the results depend on the 
actions of all the participants. It is considered a formal way to analyze interaction among a 
group of individuals who behave rationally and strategically. The participants in a game strive 
to maximize their (expected) utilities by choosing particular courses of action. Because the 
actions of the others matter, a player's final utility depends on the profile of courses of action 
chosen by all the individuals. A game deals with the following concepts: 


© Players. ‘These are the individuals who compete in the game. A player can be an indi- 
vidual or a set of individuals. 


© A move will be a player's action. 


‘A player's (pure) strategy will be a rule (or function) that associates a player's move with 
the information available to her at the time when she decides which move to choose, 


¢ A player's mived strategy is a probability measure on the player's space of pure strategies. 
‘© Payoffs are real numbers representing the players’ utilities. 


uM 


Although first attempts to analyze such problems are apparently rather old (25, modern 
game theory started with the work of John von Neumann and Oskar Morgenstern who wrote 
the book Theory of Games and Economic Behaviour (2]. Game theory is now widely used in 
research in diverse areas ranging from economics, social science, to evolutionary biology and 
‘population dynamics. 


2.2 Representations of games 


‘There are different ways to represent a strategic interaction between players. In game theory 
[0] two representations are well known: 


2.2.1 Normal form 

A normal (strategic) form of a game consists of: 
1. A finite set of N agents or players 
2. Strategy sets S;, S2,...Sy for the N players 


3, Payoff functions P,, i= 1,2,...V, are mappings from the set S; x S2 x... x Sy to the set 
of real numbers R. 


‘The set 5, x Sp x ... x Syy is called tho stratogy space S. A member s € S is known as a 
strategy profile with s = (31, 92,...9) and 5 € Si. 


2.2.2 Extensive form 
‘The extensive form of a game is a complete description of: 
1. the set of players 
2. who moves when and what their choices are 
3. the players’ payoffs as a function of the choices that are made 


4. what players know when they move 


‘The extensive form of a game, as opposed to the normal (or strategic) form, provides a more 
appropriate framework for the analysis of strategic interactions that involve sequential moves. 
It gives a richer specification of a strategic interaction by specifying who moves when, doing 
what and with what information. The easiest way to represent an extensive form game is to 
‘use a game tree, which is multi-person generalization of a decision tree (1). 


2.3 Information structure in games 


‘The information at the disposal of a player, when she has to select a move, is described by the 
information structure in the game, Based on this structure games can usually be put in either 
‘one of the following two brosd classes, which also form the two main branches of game theory. 


2.3.1 Cooperative games 


In cooperative games the players are allowed to forin binding agreements. ‘These are restrictions 
con the possible actions decided by two or more players, ‘To be binding an agreements usually 
requires an outside authority that can monitor the agreement at no cost and impose on violators 
sanctions #0 severe that cheating is prevented. For players in a binding agreement there is 
strong incentive to work together to receive the largest total payoff. ‘The agreements may 
include, for example, commitments and threats. 


2.3.2 Non-cooperative games 


In non-cooperative games the players may not form binding agreements. Neither do the players 
cooperate nor do they enter into negotiation for achieving a common course of action. However 
the players know how the actions, their own and the actions of the other players, will determine 
the payoffs of every player. 


2.4 Matrix games 


One way to describe a game is to list the players participating in the game, and to list the 
alternative choices or moves available to cach player. In the case of a two-player game, the 
moves of the first player form the rows, and the moyes of the second player the columns of 
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‘a matriz, The entries in the matrix are two numbers representing the payoff to the first and 
second player, respectively. Such a description of a game makes possible to completely represent 
the players’ payoffs by a matrix. In game theory these games are recognized as matrix games, 
‘The example below is a matrix game between two players: 


Bob 
& & — Sn 
St ( (abu) (arabia) = (awh) 
ieee (am,bu) —(@zasb22) «(aay baw) (21) 
Sw \ (anisbws) (awasbwa) (awn, bw) 


2.4.1 Constant-sum games 

In a constant-sum game, the sum of all players’ payoffs is the same for any outcome, Hence, a 
gain for one participant is always at the expense of another, such as in most sporting events. 
2.4.2 Zero-sum game 

A zero-sum game is a special case of a constant sum game in which all outcomes involve a sum 
of all player's payoffs of 0. Since payoffs can always be normalized, a constant sum game may 
be represented as (and is equivalent to) a zero-sum game. 

2.4.3 Bi-matrix games 

A class of games that have attracted much attention because of the relative simplicity of their 
mathematical analysis involve two players Alice and Bob. Each player has his own payoff matrix 
written as aj and bys, respectively. Games of this kind are called bi-matriz games. 

2.5 Examples of matrix games 


The following examples describe some well-known matrix games. 


2.5.1 Prisoners’ Dilemma 


‘The most popular bi-matrix game is the so-called the Prisoners’ Dilemma (PD) describing the 
following situation: 


‘* Two criminals are arrested after having committed » crime together and wait for their 
trial. 


© Each suspect is placed in a separate cell and offered the opportunity to confess to the 
crime. 


‘* Each suspect may choose between two stratogics namely confessing (D) and not confessing 
(C), where C and D stand for cooperation and defection. 


«# If neither suspect confesses, i. (C,C), they go free, and split the proceeds of their crime 
which we represent by 3 units of payoff for each suspect. 

‘* However, if one prisoner confesses (D) and the other does not (C), the prisoner who 
confesses testifies against the other in exchange for going free and gets the entire 5 units 
‘of payoff, while the prisoner who did not confess goes to prison and gets nothing. 

‘ If both prisoners confeas, i.e. (D,D), then both are given a reduced term, but both are 
convicted, which we represent by giving each 1 unit of payoff: better than having the 
other prisoner confess, but not so good as going free. 


‘The game can be represented by the following matrix of payoffs: 


Bob 
cD 


oes (es a) a 
D\ 0) an 


where the first and the second entry correspond to Alice's and Bob's payoff, respectively. 

For either choice of the opponent it is hence advantageous to defect (D). On the other hand, 
if both defect (D, D) the payoff remains less than in the case when both cooperate (C,C). This 
is the origin of dilemma. 


A generalized matrix for the PD is given as: 


Bob 
cD 
mene (ir oy a) 
D\ (os) (uu) 


where s<ucr<t. 


2.5.2 Battle of Sexes 


Battle of Sexes (BoS) is a bi-matrix game that can bo described as follows: 


* Alice and Bob agree to meet in the evening, but cannot recall if they will be attending 
the opera or a boxing match. 


« Alice prefers the opera and Bob prefers the boxing match. 
# Both prefer being together to being apart. 


‘Thus, while both parties prefer to find themselves at the same place, Alice and Bob cannot 
agree which event to attend. The game has the following matrix representation: 


Bob 
SiS 
‘hea (4,8) (v7) (4) 
S \ (nr) (Ba) 4 


where a > >. 


2.5.8 Matching Pennies 


Matching Pennies is a zero-sum game with two players Alice and Bob. Each shows either heads 
or tails from a coin. If both are heads or both are tails then Alice wins, otherwise Bob wins. 


‘The payoff matrix is given as 


Bob 
ae 
bee, ie os) ssi 
r\ uy 0-0 


with a winner getting a reward of 1 against the loser getting ~1. 


2.5.4 Rock-Scissors-Paper 

‘Two children, Alice and Bob, simultancously make onc of three symbols with their fists - a 
rock, paper, or scissors (RSP). Simple rules of “rock breaks scissors, scissors cut paper, and 
paper covers rock” dictate which symbol beats the other. If both symbols are the same, the 
game is 0 tie: 


Bob 
RSP 
R Tie Set | 
Mice S$} -1 0 1 (26) 
p\i -1 0 


2.6 Solution concepts 


Solving a game means finding a set of moves for the players which represent their rational 
choices. Unlike in other fields, the notion of a “solution” is more tenuous in game theory, In 
game theory a solution is generally thought of as a systematic description of the outcomes that 
may emerge during the play of a game, 


2.6.1 Rational “solution” of Prisoners’ Dilemma 


For the bi-matrix PD it is self-evident how an intelligent individual should behave. No matter 
what a suspect believes his partner is going to do, itis always best to confess (D): 


« If the partner in the other cell is not confessing (C), it is possible to get 5 instead of 3. 
+ If the partner in the other cell is confessing (D), it is possible to get 1 instead of 0. 


‘Yet the pursuit of individually sensible behavior results in each player getting only 1 unit 
of payoff, much less than the 3 units each that they would get if neither confessed (2,C). This 
conflict between the pursuit of individual goals and the common good is at the heart of many 
game theoretic problems. For PD the rational choice for both players is to defect. 


2.6.2 Nash equilibrium 


A Nash equilibrium (NE), named after John Nash, is a set of strategies, one for each player, such 
that no player has an incentive to unilaterally change her action. Players are in equilibrium if a 
change in strategies by any one of them would lead that player to earn less than if she remained 
with her current strategy. 

‘The implicit assumption behind the concept of a NE is that players make their choices 
simultaneously and independently. This idea also assumes that each player participating in 
a game behaves rational and searches to maximize his/her own payoff. A strategy profile 
sh) is a NE if none of them is left with « motivation to deviate unilaterally. 
‘Suppose P, is the ith-player’s payoff then the following condition defines the NE: 


s= (8, 


P8583 8h 108s She. Sh) > PaCSis 53, ~-87-1 Sir Sgr Sv) (2.7) 


When the NV players are playing the strategy profile s = (sj, s3,...sjy) tbe ith player’s decision 
to play s; instead of sf cannot increase his/her payoff. A NE thus defines a set of strategies that 
represents a best choice for each single player if all the other players take their best decisions 
too. 

‘The well-known Nash Theorem [23] in game theory guarantees the existence of a set of 
mixed strategies for finite non-cooperative games of two or more players in which no player can 
improve his payoff by unilaterslly changing his/her strategy. 
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2.6.3 Nash equilibrium in the Prisoners’ Dilemma 


Let Alice play C with probability p and play D with probability (1 —p), Similarly, let Bob 
play C with probability q and play D with probability (1-9). The players’ payoffs for the PD 
matrix (2,2) are 


Pa(psa) = pa(3) + p(t — 9)(0) + (1 — p)a(5) + (1 ~ p)(1—9)(1) 


=—pt4q— pot) (28) 
Palp,a) = pa(3) + r(2 ~ 9)(5) + (1 —p)q(0) + (1 —p)(1—9)(2) 
=4p-a-pat (2.9) 


‘The inequalities defining the NE in PD can be written as 


Palp",a") — Pa(p, a") = ~(p" — p)(1 +9") >0 
Palp’.a") — Pa(p’,q) = -(q" - a)(l+p") 20 (2.10) 


which produces a unique NE in the PD: p’ = q* = 0. The NE corresponds to both players 
playing the pure strategy D. 


2.6.4 Nash equilibrium in the Battle of Sexes 


Similar to the case of PD we assume that the numbers p,q € [0,1] are the probabilities with 
which Alice and Bob play the strategy Si, respectively. They then play Sp with the probabilities 
(1~p) and (1-9), respectively. Players’ payoffs for the BoS matrix (2.4) are [52]: 


alr) =Pla(a 27+ 8) +4-A]+a(1-B) +8 
Pa(,9) = 4 [pla — 27 + A) +7 ~a] + p(y-a) +a (2.11) 
‘The NE (p*,q*) is then found from the inequalities: 
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Pa(p"sa") — Palp,a*) = (" — p)|g"(a + 8 - 29) - +7] 20 
Pa(p",4") ~ Palp",a) = (9° - 9) [p"(a +6 - 29) a +7] 20 


‘Three NE arise: 


1. pt=qh=1, 
Both players play the pure strategy S;. The Nash inequalities are 


Pa(l,1) — Pa(p,2) = (1 p)a—7) 20 


Pa(1,1) — Pa(t,q) = (1-8-7) 20 


and the payoffs they obtain are 


PaQl) =a Pall.) =f 
2. P= ai =0, 
Both players now play the pure strategy $ and the Nash inequalities are 
Pa(0,0) — Pa(p,0) = (8-7) 20 
Pa (0,0) ~ Pa(0,9) = (a7) 20 
‘The players get 


Pa(0,0)=6 Po(0,0)=a 


(2.12) 


(213) 


(2.14) 


(2.15) 


(2.16) 


Shean dole 

Players play a mized strategy because p3,¢3 € (0,1). The players’ payoffs are 

2 te? 
a+h-% 

Compared to the equilibria (pj,q}) and (p3,93) the players now get strictly smaller payoffs 

because 


Palp3,a3) = Palvs, 


(a7) 


1 < Pacey.) <8 <o (2.18) 


2.7 Evolutionary game theory 


Game theory suggests static ‘solutions’ obtained by analyzing the behavior of ‘rational agents’. 
Such models are obviously unrealistic because real life behavior is shaped by trial and error. Real 
life ‘players’ are subjected to the pressures of adaptation and are forced to learn individually. In 
situations where players do not have the capacity to learn individually, natural selection favors 
better players through step-wise adaptation. John von Neumann and Oskar Morgenstern, in 
their pioneering work on game theory (2), also realized the need for such a dynamic approach 
towards game theory. After all, the word game itsclf suggests ‘motion’ in one way or the other. 

In 1970's Maynard Smith developed game-theoretic models of evolution in a population 
which is subjected to Darwinian selection. In his book Bvolution and the Theory of Games 
[22] he diverted attention away from the prevalent view ~ treating players as rational beings 
— and presented an evolutionary approsch in game theory. This approach can be seen as a 
large population model of adjustment to a NE i.c. an adjustment of population segments by 
evolution as opposed to learning. Maynard Smnith's model consisted of strategic interaction 
among the members of a population continuing over time in which higher payoff strategies 
gradually displace strategies with lower payoffs. To distinguish evolutionary from revolutionary 
changes some inertia is involved, guaranteeing that aggregate behavior does not change too 
abruptly. 

Most important feature of evolutionary game theory is that the assumption of rational 
players — borrowed from game theory ~ does not remain crucial. It is achieved when players’ 
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payoffs are equated to success in terms of their survival. Players in an evolutionary model are 
programmed to play only one strategy. Step-wise sclection assures survival of better players at 
the expense of others. In other words, an initial collection of strategies play a tournament and 
the average scores are recorded. Successful stratogics increase their share of the population. 
‘Changing the population mix changes the expected payoff. Again successful strategies increase 
in the population, and the expected payoff is calculated. A population equilibrium occurs when 
the population shares are such that the expected payoffs for all strategies are equal. 

Many successful applications of evolutionary game theory appeared in mathematical biology 
[26] to predict the behavior of bacteria and insects, that can hardly be said to think at all. 

Economists too did not like game theory that mostly concerned itself with hyper-rational 
players who are always trying to maximize their payofis. Hence the population setting of game 
theory, invented by mathematical biologists, was welcomed by the economists too. Even John 
Nash himself, as it was found later (27), had « population sctting in his mind when he introduced 
his equilibrium notion. In his unpublished thesis he wrote ‘it is unnecessary to assume that 
the participants have...... the ability to go through any complex reasoning process. But the 
participants are supposed to accumulate empirical information on the various pure strategies at 
their disposal......We assume that there is a population .......of participants......and that there 
is a stable average frequency with which a pure strategy is employed by the “average member” 
of the appropriate population'[24, 28}. 


2.7.1 Evolutionarily stable strategies 


Maynard Smith introduced the idea of an Evolutionarily Stable Strategy (ESS) in seminal 
paper ‘The logic of animal conflict’ {29}. In rough terms [30] an ESS is a strategy which, if 
played by almost all the members of a population, cannot be displaced by a small invading 
group that plays any alternative strategy. So that, a population playing an ESS can withstand 
invasion by a small group. The concept was developed by combining ingredients from game 
theory and some work on the evolution of the scx ratio [31}. 

‘Maynard Smith considers a large population in which members are matched repeatedly and 
randomly in pairs to play a bimatrix game. The players are anonymous, that is, any pair of 
players plays the same symmetric bi-matrix game. Also the players are identical with respect 
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to their set of strategies and their payoff functions. The symmetry of a bi-matrix game means 
that for a strategy set $ Alice's payoff when she plays 5; € S and Bob plays S; € S is the same 
as Bob's payoff when he plays S; and Alice plays 5. In game theory [1] a symmetric bi-matrix 
game is represented by an expression G = (M, M7) where M is the first player's payoff matrix 
and MT, its transpose, is the second players’ payoff matrix. In a symmetric pair-wise contest 
P(z,y) gives the payoff to a z-player against a y-player. In such contest exchange of strategies 
by the two players also exchanges their respective payoffs. Hence, a player's payoff is defined 
by his/her strategy and not by his/her identity. 
Mathematically speaking, [32] x is an ESS when for each strategy y # x the inequality: 


Piz, (1— 2 +e] > Ply, (1-)z +) (2.19) 


should hold for all sufficiently small ¢ > 0. ‘The left side of (2.19) is the payoff to the strategy x 
when played against the strategy (1~)z+ey whore ¢ € [0,¢9). For ¢ becoming greater than ¢ 
the inequality (2.19) does not hold and x does not remain an ESS. The situation when ¢ > ¢9 
is also known as the invasion by the mutant strategy. The quantity ¢ is called the invasion 
barrier. 

‘To be precise (27] a strategy x is an ESS: 


« If for each mutant strategy y there exists a positive invasion barrier. 


© The invasion barrier exists such that if the population share of individuals playing the 
‘mutant strategy y falls below this barrier, then = earns a higher expected payoff than y. 


‘This condition for an ESS can be shown [22] equivalent to the following two requirements: 


1. P(z,z) > P(y.z) 
2. If P(z,z) = P(y,z) thon P(z,y) > Plysy) (2.20) 


An ESS, therefore, is a symmetric NE which also possesses a property of stability against small 
mutations. Condition 1 in the definition (2.20) shows (x,2) is a NE for the bi-matrix game 


G =(M,M7) if z is an ESS, Nevertheless, the converse is not true. That is, if (z,) is a NE 
then 2 is an ESS only if 2 satisfies condition 2 in the definition, 

In evolutionary game theory the concept of fitness [33] of a strategy is considered crucial. 
‘Suppose x and y are pure strategies played in a population setting, ‘Their fitnesses are defined 
as: 


W(2) = P(x,2)F. + Plasy)Fy 
Wy) = Ply.z)Fe + Plv.a)Fy (2.21) 


where Fz and Fy are frequencies (the relative proportions) of the pure strategies « and y 
respectively. 

‘The concept of evolutionary stability provided much of the motivation for the development 
of evolutionary game theory, Presently, the ESS concept is considered as the central model of 
evolutionary dynamics of a populations of interacting individuals. It asks, and finds answer to 
it, a basic question: Which states of a population ~ during the course of a selection process that 
favors better performing strategies ~ are stablo against perturbations induced by mutations? 
‘The theory is inspired by Darwinian natural selection which is formulated as an algorithm 
called replicator dynamics, Iterations of selections from randomly mutating replicators is the 
important feature of the dynamics, The dynamics is a mathematical statement saying that in 
1a population the proportion of players which play better strategies increase with time, With 
replicator dynamics being the underlying selection mechanism in a population, ESSs come out 
[34] as stable strategies against small perturbations. In other words ESSs are rest points of the 
replicator dynamics. 


2.7.2 ESS as a refinement of Nash equilibrium 


In the history of game theory elaborate definitions of rationality, on the behalf of the players, 
led to many refinements [35] of the NE concept. In situations where multiple NE appear as 
potential solutions to a game, a refinement is required to prefer some over the others. Refine- 
ments of NE are popular as well as numerous in classical game theory. Speaking historically, 


the set of refinements became so large that eventually almost any NE could be justified in 
terms of someone ot other's refinement, The concept of an ESS is a refinement on the set of 
symmetric Nash equilibria [32]. Apart from being a symmetric NE it has robustness against 
small mutations [36]. For symmetric bi-matrix games this relationship is described as [37]: 


APS. CAFE CANE (2.22) 


where APS # & and ANE, AP®, 855 are the sots of symmetric Nash equilibria, syrimetric 
proper equilibrium, and ESSs respectively. 


Chapter 3 


Review of quantum mechanics 


Quantum mechanics: Real Black Magic Calculus 
~ Albert Binstein 


3.1 Introduction 


Quantum theory is the theoretical basis of modern physics that explains the nature and behavior 
of matter and energy on the atomic and subatomic lovel. ‘The physical systems at these levels are 
known as quantum systems. Thus quantum mechanics is a mathematical model of the physical 
world that describes the behavior of quantum systems. A physical model is characterized by 
how it represents physical states, observables, measurements, and dynamics of the system under 
consideration. A quantum description of a physical model is based on the following concepts: 


3.2 Fundamental concepts 


A state is a complete description of a physical system. Quantum mechanics associates a ray in 
Hilbert space to the physical state of a system. What is Hilbert space? 


© Hilbert space is a complex linear vector space. In Dirac’s ket-bra notation states are 
denoted by ket vectors |y) in Hilbert space. Any two state vectors differing only by an 
overall phase factor e¥ (6 real) represent the same state. 


+ Corresponding to ket vector |y) there is another kind of state vector called bra vector, 
which is denoted by (|. ‘The inner product of a bra (y| and ket |¢) is defined as follows: 


= (| hr) + (| a) 
(ol {ehds)} = eh | d1) (3.2) 


for any c € C, the set of complex numbers. There is a one-to-one correspondence between 
the bras and the kets. Furthermore 


19) = (1 ¥)° 
(HY) > 0 for |) #0 (3.2) 


‘¢ Tho state vectors in Hilbert space are normalized which means that the inner product of 
a.state vector with itself gives unity, Le., 


@iv=1 (33) 


Operations can be performed on a ket |¥) and transform it to another ket |x). There are 
operations on kets which are called linear operators, which have the following properties. 
For a linear operator & we have 


&{W) + bd} = ald) + lx) 
& {clW)} = cdelY) (3.4) 


for any ce C. 


The sum and product of two linear operators & and A are defined as: 
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{a+} Iv) = aly) +410) 
{48} 1) = 4{41)} 
Generally speaking & is not necessarily equal to Aa, Le. [24] #0 


© The adjoint 4t of an operator & is defined by the requirement: 


(1a = (atv 1x) 
for all kets |), |x) in the Hilbert space. 


‘© An operator & is said to be self-adjoint or Hermitian if: 


(35) 


(3.6) 


(3.7) 


Hermitian operators are the counterparts of real numbers in operators. In quantum me- 
chanics, the dynamical variables of physical systems are represented by Hermitian operators. 
More specifically, every experimental arrangement in quantum mechanics is associated with a 
sset of operators describing the dynamical variables that can be observed. These operators are 


usually called observables. 


3.3. Postulates of quantum mechanics 


For an isolated quantum system, quantum theory is based on the following postulates: 


+ A ket vector |) in Hilbert spsce gives a complete description of the state of the physical 


system. 


‘¢ Dynamics are specified by Hermitian operators and time evolution is given by Schrédinger’s 


equation: 
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nr = Ale) (3.8) 


where H is the Hamiltonian operator. Schrédinger's equation is a deterministic equation of 
motion that allows one to determine the state vector at any time once the initial conditions are 
provided. 

Classical games can be played when players share coins. Coins are physical systems that 
represent classical bits which takes one of the two possible values {0,1}, or simply head and 
tail. A bit is also the indivisible unit of classical information. For example in non-cooperative 
‘games coins are distributed among the players and they do their actions on them. At the end 
of the game the coins are collected by a referee who rewards the players, after observing the 
collected coins. ‘The earliest suggestions for playing quantum games can be thought of letting 
players act on qubits, which are a quantum generalization of classical two level systems like a 
coin. 


3.4 Qubits 


In two-dimensional Hilbert space an orthonormal basis can be written as {J0),|1)}. A general 
qubit state is then 


I) = 00) +5)1) (3.9) 


where a,b € C satisfying Jal? + [b(? = 1. In other words, |) is a unit vector in two-dimensional 
complex vector space for which a particular basis has been fixed. One of the simplest physical 
examples of » qubit is the spin 1/2 of an electron. The spin-up and spin-down states of an 
electron can be taken as the states {0}, |1) of a qubit. 

‘A non-cooperative classical game can be played by coin distribution and players’ rewards are 
decided after observing the coins. Likewise, a non-cooperative quantum game can be played by 
distributing qubits among the players. After the players' moves the qubits are brought together 
for an observation which is known as quantum measurement. 


3.5 Quantum measurement 


Unlike observation of coins by a referee who organizes a classical game, the concept of mea- 
surement of a quantum state of many qubits is subtle and lies at the heart of quantum theory. 
The measurement postulate of quantum mechanics states [39]: 


‘+ Mutually exclusive measurement outcomes correspond to orthogonal projection operators 
{A Aj, ..} and the probability ofa particular outcome ‘is (¥| P|). Ifthe outcome 
‘is attained the (normalized) quantum state after the measurement becomes 


Ply) 
WIATY 

Consider measurement made on  qubit whose state vector resides in two-dimensional 
Hilbert space. A measuring device has associated an orthonormal basis with respect to which 
the quantum measurement takes place. Measurcment transforms the state of the qubit into 
‘one of measuring device's associated basis vectors. Assume the measurement is performed on 
the qubit that has the state (3.9). The measurement projects the state (3.9) to the basis 
{10),[2)}. Now in this case the measurement postulate says that the outcome |0) will happen 
with probability |a|? and the outcome |1) with probability |b(?. 

Furthermore, measurement of a quantum stato changes the state according to the result of 
the measurement. That is, if the measurement of |y) = a|0) + b|1) results in 0), then the 
state |!) changes to |0) and a second measurement, with respect to the same basis, will return 
{0) with probability 1. Thus, unless the original state happened to be one of the basis vectors, 
‘measurement will change that state, and it is not possible to determine what the original state 
was. 

Although a qubit can be put in infinitely many superposition states, only a single classical 
bit’s worth of information can be extracted from it. It is because the measurement changes the 
state of the qubit to one of the basis states. 

Measurement made with orthogonal projection operators {A Pro} is also called projec- 
tive measurement, 


(310) 


3.5.1 Positive Operator-Valued Measure 


Apart from projective measurement the quantum theory also uses another important concept of 
measurement, whose implementation can be useful. It is the concept of positive operator-valued 
measure (POVM). A POVM consists of a set of non-negative quantum mechanical Hermitian 
operators that add up to the identity. The probability that a quantum system is in a particular 
state is given by the expectation value of the POVM operator corresponding to that state. 
POVMs are sometimes also referred to as the “generalized measurements”. 

Nielsen and Chuang [21] have discussed a simple example showing the utility of POVM 
formalism. Suppose Alice gives Bob a qubit prepared in one of two states, |yn) = |0) or 
Iv») = (0) + [1))/V2. It can be shown that there is no quantum measurement capable of 
distinguishing the two states with perfect reliability. However, using a POVM Bob can perform 
a measurement that distinguishes the two states some of the time, but never makes an error of 
misidentification. 

In this connection Neumark’s theorem [38] needs to be mentioned here that states that, at 
least in principle, any POVM can be implemented by the adjunction of an ancilla * in known 
state, followed by a standard measurement in the enlarged Hilbert space. 


3.6 Pure and mixed states 


Jn quantum mechanics a pure state is defined as a quantum state that can be described by a 
‘ket vector: 


w= Dal (31) 
t 


Such a state evolves in time according to the time-dependent Schrédinger equation (3.8). A 
‘mized quantum state is a statistical mixture of pure states. In such a state the exact quantum- 
mechsnical state of the system is not known and only the probability of the system being in 8 
certain state can be given, which is accomplished by the density matrix. 


TAneilla bits are extra scratch qubits that quantum operations often use. 


3.7 Density matrix 


A quantum game involves two or more players having access to parts of a quantum system. 
‘These parts are usually the subsystems of a bigger quantum system. To use the system for 
playing © game one must know it detailed statistical state. Quantum mechanics uses the 
concept of a density matrix to describe the statistical state of a quantum system. It is the 
quantum-mechanical analogue to a phase-space density (probability distribution of position 
and momentum) in classical statistical mechanics. Suppose the quantum state of a system is 
expressed in terms of a denumerable orthonormal basis {|¢n), n= 1,2,3...}. The state y(t)) 


of the system at time t in the basis is given as 


WC) = SYan(t) lon) 


Let |9(t)) be normalized 


(9) 19) =1= PY an(t)eta(t) (bm | Aa) =D onCE)!? 


‘The matrix elements of a self-adjoint operator O in the basis are 


Gran = ($m | On) = (Om | tu) = (ml © lm) 


‘The average (expectation) value of O at time t for the system in state |y(t)) is 


(6) = (wie) 16000) = DD an (tanlt) Orn 


Consider the operator |y(t)) (¥(¢)|. It has matrix elements 


(rm | w(t) (CE) | bn) = @m(than(t) 


The calculation of (6) involves these matrix elements, Hence define 


lt) = |9(t)) (COL 
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(3.12) 


(3.13) 


(3.14) 


(3.15) 


(3.18) 


(3.17) 


which is known as the density matric of the pure state |i(¢)). It is a Hermitian operator, acting 
on the Hilbert space of the system in question, with matrix elements 
Pron = (bm | A(t) Pn) = Or(t}a(t) (3.18) 
Eq. (3.17) shows that for a pure state the density matrix is given by the projection operator of 
this state. 
Since |y(t)) is normalized, we also have 
1= S)lan()? = yonn() = Te fot) (3.19) 


‘The expectation value of the observable O can now be re-expressed using the density operator: 


(8) = DYemt08 (0) = TD Pam} 
=> [9] =) ro (3.20) 
For a mixed state, where a quantum system is in the state l¥s(t)) with probability p;, the 
density matrix is the sum of the projectors weighted with the appropriate probabilities: 
Ut) = ps bvs(®) (WsC0L (3.21) 
7 


Density matrix is a powerful tool in quantum games because game usually involves « multi- 
partite quantum system. Compared to the description of a quantum game based on state 


vectors, density matrix provides much compact notation. 


3.8 Quantum Entanglement 


‘Some of the most interesting investigations in quantum games concern the relationship between 
game-theoretic solution concepts and entanglement present within the quantum system that 
players are using to play the game. ‘The phenomenon of entanglement can be traced back to 


Einstein, Podolsky and Rosen (EPR)’s famous paper [40] of 1935. EPR argued that quantum 
mechanical description of physical réality can not be considered complete because of its rather 
strange predictions about two particles that once have interacted but now are separate from one 
another and do not interact. Quantum mechanics predicts that the particles can be entangled 
‘even after separation. Entangled particles have correlated properties and these correlations are 
at the heart of the EPR paradox. 

Consider a system that can be divided into two subsystems. Assume H and Hg to be 
the Hilbert spaces corresponding to the subsystems. Let |i), (where i = 1,2,...) be a complete 
orthonormal basis for Ha, and |j)5 (where j = 1,2,...) be a complete orthonormal basis for 
Hp. In quantum mechanics the Hilbert space Ha ® Ha (tensor product) is associated to the 
‘two subsystems taken together. The tensor product Hilbert space H @ Hz is spanned by the 
states |i), @|j)g. By dropping the tensor product sign |i) @ li) g is also written as {), lj) - 
Any state of the system |¥) 4a is a linear combination of the basis states |i), |j)p ic. 


Mas= oldalde (322) 
[Si 


where ¢;; are complex coefficients. State |W), is usually taken to be normalized 


Die =2 (323) 
a 


A state |W) 4p is a direct product state when it factors into a normalized state |y(4)), = 
Dol” fi) in Ha and a normalized state |p"), = Tel) |i) p in Hp ive. 
$ a 


Wa=|),¥™), = (Ee) (=e uw) ea) 


Now, interestingly, there exist some states in H4@ Hg that can not be written as product 
states. The state ({1),[1)p +12) 412)n)/V2 is one example. When |W),p 18 not » product 
state it is called entangled [41, 21]. 

Quantum games have extensively used entangled states to see the resulting affects on solu- 
tions of a game. However, it is considered a usual requirement in quantum games that players’ 
‘access to product states leads to the classical game. 


a7 


| 
Chapter 4 
Quantum games 


4.1 Introduction 


It is difficult to trace back the earliest work on quantum games. Many situations in quantum 
theory can be reformulated in terms of game theory. Several works in the literature of quantum 
physics can be identified having game-like underlying structure, For example: 


‘¢ Wiesner's work on quantum money [13]. 


‘+ Mermin’s account [42] of Greeberger, Horne, and Zeilinger (GHZ)’s [43] version of the 
Bell’s theorem (44, 38] without inequalities. 


 Elitzur-Vaidman bomb detector [45], suggesting an interferometer which splits a photon 
in two and then puts it back together again (interaction-free measurement). 


 Vaidman's illustration (15] of GH2’s version of the Bell’s theorem. 
‘© Meyer’s demonstration [19] of « quantum version of a penny-flip game. 
‘ Bisert, Wilkens, and Lewenstein's [20] quantization of the famous game of Prisoners’ 


Dilemma (PD). 


In general, a quantum game can be thought of as strategic manoenvreing of a quantum 
system by parties who have necessary means for such actions. Some of its essential parts can 
bbe recognized as follows: 
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‘+ A definition of the physical system which can be analyzed using the tools of quantum 
mechanics, 


+ Existence of one or more parties, usually referred to as players, who are able to manipulate 
the quantum system. 


© Players’ knowledge about the quantum system on which they will make their moves or 
actions, 


© A definition of what constitutes a strategy for a player. 


‘A definition of strategy space for the players, which is the set of all possible actions that 
players can take on the quantum system. 


A definition of the pay-off functions or utilities associated with the players’ strategies, 


A two-player quantum game, for example, is a st {46}: 


P= (H,p,Sa,Sa, Pa, Pa) (4) 


consisting of an underlying Hilbert space 21 of the physical system, the initial state p, the sets 
4 and Sp of allowed quantum operations for two players, and the pay-off functions or utilities 
Py and Pp. In most of the existing set-ups to play quantum games the initial state p is the 
state of one or more qubits. More complex quantum systems like qutrits (three-dimensional 
quantum systems) or even qudits (d-dimensional quantum system) can also be used to play 
quantum games. 


4.2 Why games in the quantum world? 


‘The question why game theory can be interesting in the quantum world has been addressed in 
the earliest suggestions for quantum games. Sotne of the stated reasons (19, 20] are: 


+ Classical game theory is based on probability to a large extent, Generalizing it to quantum 
probability is fundamentally interesting. 


‘* Quantum algorithms may be thought of as games between classical and quantum agents. 
Only a few quantum algorithms are known to date. It appears reasonable that an analysis 
of quantum games may help finding new quantum algorithms. 


‘¢ There is an intimate connection between the theory of games and theory of quantum 
communication. Eavesdropping (16, 17] and optimal cloning [18] can readily be conceived 
as games between players. 


© Quantum mechanics may assure fairness in remote gambling {14}. 


«# If the ‘Selfish Gene’ [47] is a reality then the games of survival are already being played 
at molecular level, where quantum mechanics dictates the rules. 


4.3 Examples of quantum games 


AAs the subject of quantum games has developed during recent years, many examples have been 
put forward illustrating how such game can be different from their classical analogues. Here 
are some of the well known quantum games: 


4.3.1 Vaidman’s game 


Vaidman [15] presented an example of a game for a team of three players that can only be won 
if played in the quantum world. Three players are sent to remote locations A, B and C. At a 
certain time t each player is asked one of the two possible questions: 


1. What X? 

2. What ¥? 

Both of these questions have +1 or —1 as possible answers. Rules of the game are such that: 
« Either all players are asked the X question or 

# Only one player is asked the X question and the other two are asked the Y question. 


‘The team wins if 


‘* The product of their three answers is —1 in the case of three X questions or 


© The product of three answers is 1 in the case of one X and two ¥ questions. 


‘What should the team do? Let X, be the answer of player A to the X question. Similarly, 
one can define Xp, Xc etc. The winning condition can now be written as 


X4XpXe= 
XaYa¥o=1 
YaXp¥o =1 
YaYeXc =1 (4.2) 


‘The product of all left hand sides of Eqs. (4.2) is X4X$XBYZYBY = 1, because each of the X 
cor Y take the values +1 only. The product of right sides is -1, which leads to a contradiction. 
‘Therefore, the game cannot be won, with a success probability of 1, by a team of classical 
players. Eqs. (4.2) show that the probability of winning the game by classical players can not 
exceed 3/4. However, Vaidman showed that a quantum solution exists for the team. Three 
particles are prepared in a correlated state (GHZ): 


|GHZ) = Flltedaltade Itzde-Mz)allz)ellz)c} (4.3) 
If a member of the team is asked the X question, she measures ,. If she is asked the Y 
question, she measures Gy instead. Quantum mechanics implies that for the GHZ state one 
gets [15] 


64.42,6c, =-1 

Faste,80, =1 

6a,68.80, =1 

a,08,8¢, =1 (44) 


aL 


‘The Vaidman’s game can, therefore, be won by a group of quantum players with 100% success 
probability. 

‘There remains a subtle point in Vaidman’s argument. The contradiction obtained by com- 
paring the four equations in (4.2) assume that all four equations hold simultaneously. In fact, 
the four equations represent four incompatible situations. 


4.3.2. Meyer's PQ Penny-Flip 


‘Two players can play a simple game if they share a coin having two possible states, head or 
tail. The first strong argument for quantum games was presented by Meyer [19] as a coin flip 
game played by two characters, Captain Picard and Q, from the popular American science 
fiction series Star Trek. In a quantum version of the game the flipping action is performed on 
‘8 “quantum coin”, which can be thought of as an electron that, on measurement, is found to 
exist either in spin-up (H) or in spin-down (7) state. 

In Meyer's interesting description of a quantuin game, the story starts when starship En- 
terprise faces some imminent catastrophe. Q appears on the bridge and offers Picard to rescue 
the ship if he can beat him in a penny-flip game, Q asks Picard to place the penny in a box, 
head up. Then Q, Picard, and finally Q play their moves. Q wins if the penny is head up when 
the box is opened. For classical version of this game the payoff matrix can be constructed as 


Q 
NN NF FN FF 
wf-1 1-1 
Picard (4) 
1-1 -11 
where rows and columns are Picard’s and Q's pure strategies respectively. Let (H,T) be the 
basis of a 2-dimensional vector space. The players’ moves can be represented by sequence of 
2.x 2 matrices. In the matrix (4,5) the moves ‘to flip’ and ‘not to flip’ are represented by F 
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ne 


and N, respectively: 


HT ae 


ae 4 Se ) 
P: N: (46) 
T 190 T\o1 


defined to act, on left multiplication, on a vector representing the state of the coin. A general 
mixed strategy is described by the matrix: 


Hf(i-p p 
| ; ie an 


where p € [0,1] is the probability with which the player flips the coin. A sequence of mixed 
actions puts the state of the coin into convex linear combination aH-+(1—a)T where 0 < a <1. 
‘The coin is then in H state with probability a. Q plays his move first, after Picard puts the 
coin in the HT state. 

Now Meyer presents a look at a quantum version of this game. Q has studied quantum 
theory and implements his strategy os a sequence of unitary rather than stochastic matrices. 
‘Such action requires a description of the state of the coin in two-dimensional Hilbert space. Let 
its basis be the kets |H) and |), in Dirac notation. A pure state of the coin is aff) + b|T) 
where a,b € C and aa* + bb* = 1. 

Given the coin is initially in the state |H), the following unitary action U(a,b) by Q puts 
the coin into the state a|#) +5|T): 


HT 


U(a,) = (5 2 ) (48) 


esae 


Using the density matrix notation, the initial state of the coin can be written as 


po = 1H) (H| (4.9) 
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Q's unitary action U(a,6) changes the state pp to 


= Upolt = I ae ) (410) 
ba® bir 


because unitary transformations act on density matrices by conjugation. Picard is restricted to 
use only a classical mixed strategy (4.7) by flipping the coin with probability p. After his action 
tthe coin is in the pure state b|#) + aT) with probability p and in the pure state a|H7) + 6|7) 
with probability (1 ~p). Picard’s action acts on the density matrix py, not as a stochastic 
matrix on a probabilistic state, but as a convex linear combination of unitary (deterministic) 
transformations: 


m= PPAF! +(1~p) NaN! 


2 ( pbb* + (1-p)aat pba’ + (1 —p)abt ) 


4.11) 
pab* +(1—p)ba* paa* +(1—p)bbt ) 


Interestingly, Q has at his disposal a move: 
es (Ey ip eae! 
U, = U(-, = 4.12) 
Dey alia) a) 
that can put the coin into a simultancous eigenstate with eigenvalue 1 of both # and N, which 
then becomes an invariant under any mixed strategy pF'+ (1 ~p)N of Picard. In his second 


action Q acts again with U( Jy Jy) and gets back the state po = |H) (H| and wins. The game 
can also be understood with the following chart, 


q x Picard = Q 
my = Zim = eum) ay (as) 
abi re a 


oz ort 


P o1 
where H = ( ae ) is a Hadamard transformation and o, = ( é ) is the flipping 
lel 1 
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operator. |H) is the head state of the coin and J is the identity operator. Q plays a quantum 
strategy by putting the coin into a symmetric superposition of head and tail. Now, whether 
Picard fips the coin or not, it remains in the symmetric superposition which Q can rotate back 
to head applying A again since # = H™*. 


4.3.3 Eisert, Wilkens and Lewenstein’s quantum Prisoners’ Dilemma 


Eisert, Wilkens, and Lewenstein [20] gave a physical model of the PD and suggested that the 
players can escape the dilemma if they both resort to quantum strategies. Their physical model 
consists of 


« A source making available two bits, one for each player. 


‘« Physical instruments enabling the players to manipulate, in a strategic manner, their own 
bits. 

‘+ A measurement device that determines the players’ payoffs from the final state of the two 
bits. 


In a quantum formulation the classical strategics C and D are assigned two basis vectors 
IC) and |D) in Hilbert space of a qubit. A vector in the tensor product space, which is spanned 
by the classical game basis |CC) ,|CD) ,|DC) and |DD) describes the state of the game. 

‘The game's initial state is |¥in) = J|CC) where J is a unitary operator known to both 
players. Alice and Bob's strategic moves are associated with unitary operators U4 and Up 
respectively, chosen from a strategic space S. The players’ actions are local i.e. each operates 
on his/her qubit. After players’ moves the state of the game changes to (04 ® Us)J|CC). 
Measurements are now performed to determine the players’ payoffs. Measurement consists 
of applying a reverse unitary operator Jt followed by a pair of Stern-Gerlach type detectors. 
‘Before detection the final state of the game is given by 


ty) = J"(0, @0p)J \CC) (4.14) 


Eisert et al. [20] define Alice's expected payoff as 


Pa=rKCC|¥p)P +s(CD| vy) +tKDC |v)? +ulDD| vy)? (4.18) 
where the quantities r,s,¢ and u are from the PD matrix (2.3). Bob's payoff Pg is obtained by 
interchanging s ++ t in Eq. (4.15). Bisert and Wilkens [46] use following matrix representations 
of unitary operators of their one- and two-parameter strategies, respectively: 


~sin(@/2) cos(@/2) 
 cos(0/2) sin(@/2) ) 
=sin(0/2)e~cos(0/2) 


ame ( cos(o/2) sin(0/2) ) is 


U(6,d) = ( (417) 


where 0 < @ <x and 0 < $< 1/2. To ensure that the ordinary PD is faithfully represented in 
its quantum version, Eisert et al. imposed additional conditions on J: 


[4,608] -0,[,d0¢] -0,[J,¢e5] =0 (418) 
where G and D are the operators corresponding to the strategies of cooperation and defection 
respectively. A unitary operator satisfying the condition (4.18) is 


j=en{indodp} (419) 
where 7 € [0,7/2]. J can be called a measure of the game’s entanglement. At 7 = 0 the game 
reduces to its classical form. For a maximally entangled game -y = 7/2 the classical NED @ D 
is replaced by a different unique equilibrium @ @ Q with Q ~ 0(0,x/2). The new equilibrium 
is also found to be Pareto optimal, that is, a player cannot increase his/her payoff by deviating 
from this pair of strategies without reducing the other player's payoff. Classically (C,C) is 
Pareto optimal, but is not an equilibrium. Bisert et al. claimed that in its quantum version the 
dilemma in PD disappears from the game and quantum strategies give a superior performance 
if entanglement is present. 
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O@)or 
500.9) 
Figure 4-1: Bisert et al.'s scheme to play a quantum game, 
In density matrix notation, the players’ actions change the initial state p to 
2=(01@0a)e0n@0n)! 


‘The arbiter applies the following operators on ¢: 


fee =\Weo) Weel, tc = hen) (Yeo| 


#pe=\Woe) (bocl, #00 = Wn) (bool 


‘The expected payoffs are 


Pas = [Pocla.eTltcc8] + (Peola,eTrhicp4] 
+ [Pocla.eTH#De8] + [Pop|a,eT#pD4] 
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(4.20) 


(4.21) 


(4.22) 


Where, for example, [Pop] is the Alice's classical payoff when she plays C and Bob plays D. 
For one-parameter strategies the classical pure strategies C and D are realized as U(0) and 
O(), respectively; while for two-parameter strategies the classical pure strategies C’ and D are 
realized as 0(0,0) and &(x,0), respectively. Fig. (4-1) shows Bisert et al.'s scheme to play a 
quantum game, 

Many recent investigations (48, 49, 50, 51] in quantum games have been motivated by the 
Eisert et. al.'s scheme. 


4.3.4 Quantum Battle of Sexes 


Motivated by the Eisert et al.'s proposal, Marinatto and Weber (52 introduced a new scheme 
for quantizing bi-matrix games by presenting a quantized version of the BoS. In this scheme 
a state in a 2@2 dimensional Hilbert space is referred to as a strategy. At the start of the 
game the players are supplied with this strategy. The players manipulate the strategy, in the 
next phase, by playing their tactics. The state is finally measured and the payoffs are rewarded 
depending on the results of the measurement. A player can do actions within a two-dimensional 
subspace. Tactics are therefore local actions on # player's qubit, The final measurement, made 
independently on each qubit, takes into consideration the local nature of players' manipulations. 
Ii is achieved by selecting a measurement basis that respects the division of Hilbert space into 
two equal parts. 

Essentially, the scheme differs from the earlier proposed scheme of Eisert et al. [20] by the 
absence of reverse gate Jt. The gate makes sure that the classical game remains a subset of 
its quantum version. In Marinatto and Weber's scheme the state is measured without passing 
it through the reverse gate. They showed that the classical game still remains a subset of the 
quantum game if the players’ tactics are limited to a probabilistic choice between applying the 
identity I and the Pauli spin-flip operator 6. Also the classical game results when the players 
are forwarded an initial strategy in) = [00). 

Suppose pin is the initial strategy, which the playors Alice and Bob receive at the start of 
the game. Let Alice acts with identity / on giq with probability p and with é, with probebility 
(1 =p). Similarly, let Bob acts with identity / with probability q and with 4, with probability 
(14). After the players’ actions the state changes to 
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prin = Pala ® Iapinth @ fh, + (1 - 9)1A®@ Genpinll, @ aly + 
(1 ~ Pitz ® fnpind!, @ I+ 


(1-2) ~ dea @Gsapind!, @6!5 (4.23) 
For the bi-matrix: 
Bob 
SS 
ice 5! ( (428) Bade) asa 
5 \ (rata) (bas52) 


Marinatto and Weber defined the following payuif operators 


(Pa)oper = e14[00) (00 + a J01) (01] +74 120) {10} + 4,4 2) (12) 
(Pooper = ex (00) (00] + Ag 02) (01 + yp [10) (10) + dy [21) (1) (4.25) 


where the states |0) and |1) are used for the measurement basis, corresponding to the pure 
strategies Sy and 52, respectively, ‘The payoff functions are then obtained as mean values of 
these operators: 

Paya = Tr {(PA,B)operPjin} (4.26) 


Fig. (4-2) sketches the idea of playing a quantum game in Matinatto and Weber's scheme. 
‘The scheme was developed for the BoS given by tho matrix (2.4). On receiving an initial 
strategy: 


You = a0) + [1)) (427) 


the players’ tactics cannot change it, and the final strategy remains identical to the initial one. 
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Figure 4-2: Marinatto and Weber's scheme to play 8 quantum game. 


‘The players’ expected payofis are maximized for the tactics p* = g* = 0 or p* = qt = 1, that 
is, both players either apply 42 with certainty or / with certainty. In either case the expected 
payoff is (a+ )/2 to each player, Marinatto and Weber suggested that a unique solution thus 
exists in the game. 


4.3.5 Quantum version of the Monty Hall problem 


Monty Hall is a game in which Alice secretly selects one door out of three to place a prize there. 
It is now Bob's turn who picks a door, Alice then opens a different door showing that the prise 
is not behind it. Bob now has the option of changing to the untouched door or sticking with 
his current selection, In classical version of the game Bob's optimum strategy is to alter his 
choice of door and it doubles his chances of winning. 

Liet al. (63), Flitney and Abbot {64] and D'Ariano et al. (55) have proposed various 
quantum versions of the Monty Hall problem. 


4.3.6 Quantum market games 


During recent years Piotrowski and Sladkowski (56, 57, 58] have proposed ‘quantum-like descrip- 
tion of markets and economics. This development can be shown having roots in quantum. game 
theory and is considered part of new field of econophysics. In econophysies [60] mathematical 
techniques developed by physicists are used to analyze the complex financial and economic 
systems. Developments in econophysics have motivated some authors [61] to ask about the 
possibility of a meaning of Heisenberg uncertainty principle in economics. Others have even 
claimed that quantum mechanics and mathematical economies are isomorphic (62). 


4.3.7 Quantum Parrondo’s Games 


A Parrondo’s game is an interesting problem in game theory. Two games that are losing when 
played individually can be combined to produce a winning game. ‘The game can be Put into 
the form of a gambling utilizing a set of biased coins. 

Flitney and Abbott (63, 64] studied a quantum version of the Parrondo's game where the 
rotation operators representing the toss ofa classical biased coin are replaced by general SU(2) 
operators to transform the game into the quantum domain. They found that superposition of 
qubits ean couple the two games and produce interference leading to different payofls than in 
the classical case. 
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Chapter 5 


Comments on proposed set-ups to 


play quantum games 


Meyer [19] demonstrated with the example of a penny-flip game how quantum mechanics can 
affect yame theory. He introduced a game where a suitable quantum strategy can beat any 
Classical strategy. Comments and criticiam followed soon after this demonstration of the power 
‘of quantum strategies, which are reviewed in the following. 


5.1 Enk’s comment on Meyer’s quantum Penny-Flip 


‘Though agreeing that Meyer reached a correct conclusion, Enk (65] commented that Meyer's 
particular example is flawed for the following reasons: 
* Q's quantum strategy can also be implemented classically. 
‘+ Meyer’s game only shows the superiority of an extended set of strategies over a restricted 
‘ono, which is not surprising. 
+ A single qubit is not truly © quantum systom because its dynamics and its response to 
measurements can also be described by a classical hidden-variable model. Bell's inequal- 


ities, or the Kochen-Specker theorem, do not exist for a two-dimensional system, thus 
making it possible to explicitly construct classical models for such systems, 
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5.1.1 Meyer's reply 
Meyer replied (66) and disagreed with Enk’s claim that the existence of classical models for 
Q's strategy necessarily prevents it from being called quantum mechanical. He argued as the 
following: 
‘+ Enk's claim implies that P's strategy is also not classical because quantum models exist 
for flipping a two-state system, 
+ Though classical models do indeed exist for qubit systems but they scale exponentially 
‘a8 the number of qubits increase. 


Entangled qubits do not possess classical models but entanglement itself has been shown 
unnecessary to outperform a quantum algorithm from a classical one. For example, Grover's 
algorithm [8], although discovered in the context of quantum computation, can be implemented 
using a system allowing superposition of states, like classical coupled simple harmonic oscillators 
[67]. It does not seem fair to claim that such an implementation prohibits calling it a quantum 
algorithm. 

Related to the third point in Enk’'s comment, it seems related to mention that recently 
Khrennikov [68] proved an analogue of Bell's inequality for conditional probabilities. Interest- 
ingly the inequality can be applied not only to pairs of correlated particles, but also to a single 
particle. The inequality is violated for spin projections of the single particle, Khrennikov con- 
cludes that a realistic pre-quantum model does not exist even for the two-dimensional Hilbert 
space. 


5.2 Benjamin and Hayden’s comment on quantization of Pris- 
oners’ Dilemma 

Eisert et al. obtained Q as the new quantum equilibrium in PD, when both players have 

access to a two-parameter set (4.17) of unitary 2 x 2 matrices. Benjamin and Hayden (69] 

observed that when their two-parameter set is extended to all local unitary operations (i.e. all 

of SU(2)) the strategy @ does not remain an equilibrium. They showed that in the full space 

of deterministic quantum strategies there exists no equilibrium for Eisert et al.'s quantum PD. 
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‘They also observed. that Eisert’s set of two-parameter quantum strategies is not closed under 
composition, which is reasonable requirement for a set of quantum strategies. 


5.3 Benjamin’s comment on Marinatto and Weber’s quantum 
Battle of Sexes 


In his comment Benjamin [70] made two observations about Marinatto and Weber's quantum 
battle of sexes: 


* The overall quantization scheme is fundamentally very similar to the Eisert et al.’s pre- 
viously proposed scheme [20}. 


+ The quantum BoS does not have a unique solution. Though the dilemma may be easier 
to resolve in its quantum version, the players still face it as they do in the traditional 
game. 


In the quantum Bos the players's expected payoffs are maximized when their tactics consist 
ofeither both applying f with certainty (p* = 1,9 = 1) or both applying 6. with certainty (p* = 
0,9" =0). Marinatto and Weber concluded that an entangled initial strategy (00) +{11))/v3, 
therefore, gives a unique solution in the game. Given that the players’ tactics are independent, 
the players are faced with a dilemma once again in opting for (p* = 1,9" = 1) or (p* = 0,q° = 0). 
Mismatched tactics, i.e. (p* = 1,4* = 0) or (p* = 09° = 1), both lead to a worst-case situation. 

Benjamin [70] also pointed out a difference in terminology. In Marinatto and Weber's set-up 
an initial strategy, in the form of a quantum state, is forwarded to the players who then apply 
their tactics to modify the state. In the Eisert ot al.'s scheme, on the other hand, players? 
‘moves’ are their manipulations, snd their overall act of choosing what move to play is their 
strategy. 

Recently Nawaz and ‘Toor [71] showed that by using a more general initial quantum state 
the dilemma in the classical BoS ean be resolved, and a unique solution can be found. 


5.3.1 Marinatto and Weber’s reply 


In a reply Marinatto and Weber [72] defended their choice of calling strategies the quantum 
states instead of operators used to manipulate them. ‘They claimed that their choice is very 
natural and consistent with the spirit of classical game theory, where at the start of a game 
each player has at her disposal an ensemble of strategies. 

Regarding Benjamin's claim that the dilomma persists in quantum BoS since players cannot 
decide between the two options, i. (p* = 0,q* = 0) and (p* = 1,q" = 1), Marinatto and Weber 
replied that the second option of doing nothing (p* = 1,q* = 1) amounts to the most rational 
behavior of the two players. According to them no incentive exists for a player for doing 
something (i.e. p* = 0 or q* =0) because: 


* It cannot lead to a better payoff and each player knows that. 
‘+ Tt only generates the extra risk of incurring a loss. 


« It is more expensive than doing nothing, in terms of resources needed to operate on the 
strategies. 


5.3.2 ‘Quantum form’ of a matrix game and initial quantum states 


In Bisert et al.'s sct-up when the parameter + of the initial quantum state is different from zero, 
the players’ payoffs are generally non-classical, except for special moves available to them that 
can result in the classical payoffs. Eisert et al. allow a range of values to the parameter -y and 
found how it affects the equilibria of the game. 

Marinatto and Weber [52] forward an initial strategy to the two players who then apply 
their ‘tactics’ on it, In their scheme the classical game corresponds to the initial state [00). 

Suppose the players receive pure two-qubit states, different from |00), but the measurement 
uses the same payoff operators. The payoff operators used in measurement in Marinatto and 
‘Weber's scheme contains all the information about what matrix game is being played. Given 
the measurement apparatus remains the same, a ‘quantum form’ of the matrix game can be 
obtained by only choosing among different initial states. Hence, this approach translates the 
problem of finding a quantum form of @ matrix game to the problem of finding a pure initial 
state. 


‘The approach should be seen from the view that the only restriction on a ‘quantum form’ of 
‘4 game is that the corresponding classical game must be reproducible as a special case. Because 
4 product initial state results in a classical game, therefore, the above approach is within the 
mentioned restriction. 

‘The Bisert et al.'s set-up suggests studying the behavior of equilibria in relation to the 
Parameter 7. The above approach, on the other hand, suggests studying the behavior of 
equilibria in relation to different pure initial states, 


5.4 Enk and Pike’s comment on quantum Prisoners’ Dilemma 


More recently Enk and Pike (73] have argued that the quantum solutions of PD, found by 
Bisert et al. (20), are neither quantum mechanical nor do they solve the classical game. ‘Their 
argument is based on the observation that it is possible to capture the essence of quantized PD 
by simply extending the payoff matrix of the classical game, by only including an additional 
purely classical move corresponding to Q, which Bisert et al. obtained as a new quantum- 
‘mechanical ‘solution-move’ that could remove the dilemma inherent in the game. Enk and Pike 
maintained that when Eisert's quantum solution to PD can be reconstructed in a classical way, 
the only defense that remains for its quantum solution is ita efficiency, which does not play a 
role in PD, 

Enk and Pike also suggested that a quantum game that exploits non-classical correlations 
in entangled states, similar to those that violate the Bell's inequality, should be worthy of in- 
vestigation, Such correlations are without a role in Eisert et al.'s set-up, and other quantigation 
procedures derived from it, even though entangled states may be present. It is because various 
qubits, after their local unitary manipulations, are brought together during the final stage of 
the game to make the payofly-generating measurement. 
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Chapter 6 


Evolutionary stability in quantum 


games 


6.1 Introduction 


As discussed in Section (2.7), the concept of an ESS was introduced in claical game theory 
for two reasons: 


1 ‘Two player games can have multiple Nash equilibria and ESS offers its refinement notion, 
2. Population biology problems can be modelled with the help of the ESS concept, 


‘The reasons for claim that (1) holds for quantum as well as classical games are not far from 
bvious. In our opinion the reason (2) lao has « moaning in a quantum context, Like NE, the 
BSS is a game-theoretic concept. The concept assumes a population setting which is relevant 
‘© problems in evolutionary biology. As a game-theoretic concept, the ESS is equally worthy 
of investigation as the concept of NE is in relation to quantization of games. ‘The view that 
® population setting of evolutionary biology can not be relevant in quantum games is based 
on the assumption that the participants in a quantum game must always be rational agent, 
We believe that when the rewards for players, forming a population, not only depend on their 
individual moves but also on whether the game they play is classical or quantum in nature, 
then the concepts fundamentally developed for a population setting also become relevant in 
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‘ quantum context. As mentioned in the Section (2.7), John Nash himself had a population 
setting in his mind when he introduced his equilibrium notion. His equilibrium notion is well- 
known from the early known studies in quantum games. ‘The fact that a population setting was 
behind the notion of a NE provides an almost natural relevance of this setting for the quantum 
‘games as well. The idea of « population of ‘quantuin players’ itself is not very much beyond 
imagination. Such a population may, for example, consist of a large number of interacting 
molecules where ‘decisions’ are taken in individual quantum interactions. ‘These interactions 
can easily be imagined pair-wise and also random, which are the fundamental assumptions 
behind the concept of an ESS, 

Tn quantum setting the players’ payoffs become sensitive to quantum affects. Which direc- 
tion evolution drives the population of quantum players now? ‘The direction should, of course, 
bbe decided by the nature of quantum affects, 


6.2 Quantization as a refinement notion of Nash equilibrium? 


Research in quantum games (20, 52] has shown appearance of entirely new equilibria on quanti- 
ation of a game. The next logical question is to ask whether quantization can provide another 
refinement to the NE concept? Such a question is relevant in a situation where an equilibrium 
i retained, whether the game is played classically or quantum mechanically, but some property 
of the equilibrium changes during such a switch-over. ESS, being a refinement notion of the 
NE concept, is a symmetric NE with an extra property of stability against small perturbations, 
We believe the question whether quantization can alfect stability of a symmetric NE is equally 
interesting as the question how quantization leads to different equilibria, 


6.3 Quantization changing evolutionary stability? 


Our motivation is how game-theoretic models, of evolutionary dynamics in a population, shape 
themselves in the new setting recently provided to game theory by quantum mechanics? This 
‘motivation is, in a sense, a portion of a bigger question: Can quantum mechanics have a role 
in directing, or even dictating, the dynamics of ovolution? To study evolution in a quantum 
setting we have chosen the ESS concept firstly for its beauty and simplicity. Secondly, because 
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ESS is a game-theoretical concept, the new developments in quantum games themselves pro- 
vide a motivation to look at the resulting effects on such concepts. Following questions arise 
immediately: 
« How ESSs are affected when a classical game, played by a population, changes itself to 
‘one of its quantum forms? 
«How pure and mixed ES$s are distinguished from one another when such a change in the 
form of a game takes place? 
And most importantly 


‘* How and if evolutionary dynamics can be related to quantum entanglement? 


Imagine a population of players in which a classical strategy has established itself as an 
ESS. We ask: 


‘* What happens when ‘mutants’ of ESS theory come up with quantum strategies and try 
to invade the classical ESS? 


‘© What happens if such an invasion is successful and a new ESS is established ~ an ESS 
that is quantum in nature? 


‘© Suppose afterwards another small group of mutants appears which is equipped with some 
other quantum strategy, Would it be successful now to invade the quantum ESS? 
In the following we present an analysis based on these questions considering « population 
in which symmetric pair-wise contests are taking place. 
In trying to extend an ides, originally proposed for problems in population biology, to 
quantum domain we give an analysis using Hisort ct al.'s quantization of the symmetric bi- 
matrix game of PD. 


6.4 ESSs in Eisert, Wilkens and Lewenstein’s scheme 


For PD Cooperation (C) and Defection (D) are the pure classical strategies. Which strategies 
are likely to be stable and persistent when the game is played by a population engaged in 
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pair-wise contests? In each such contest PD is played. Straightforward analysis [33] shows that 
D will be the pure classical strategy prevalent in the populstion and hence the classical ESS. 

Eisert et al. used the matrix (2.2) in their quantum version of PD. Assume a population 
setting where in each pair-wise encounter the players play PD with the same matrix. Consider 
the following three situations: 


1. A small group of mutants appear equipped with one-parameter quantum strategy (0) 
when D exists as a classical ESS. 


2. The mutants are equipped with two-parameter quantum strategy 0(0,¢) against the 
classical ESS. 


3. The mutants have successfully invaded and a two-parameter quantum strategy Q ~ 
0 (0,/2) has established itself as a new quantum ESS. Again another small group of 


‘mutants appear, using some other two-parameter quantum strategy, and try to invade 
the quantum ESS, that is Q. 


6.4.1 Case (1) 


Tn quantum PD with the matrix (2.2): 


( G3) 3) ) ich 
60) (1) 
the players are anonymous and one can denote, for cxamplo, P(G(6), D) to represent the payoff 


to O(0)-player against the D-player. Here 0 (0) is the Bisert et al.'s one-parameter qitantum 
strategy set (4.16). Players’ payofis can be found as 


P(O(0), D) = sin*(0/2) 
P(G(0),0(0)) = 2cos*(/2) + 5.c0s*(0/2) sin®(0/2) +1 
P(D, (0) = 5.cos*(0/2) + sin*(@/2) 
P(D,D)=1 (6.2) 


Now P(D,D) > P(0(0),D) for all @ € (0,7). Hence the first condition for an ESS holds and 
D ~ 0 (x) is an ESS. The case @ = x corresponds to one-parameter mutant strategy coinciding 
with the ESS, which is ruled out. If D ~ U(x) is played by almost all the members of the 
Population ~ which corresponds to high frequency Fp for D - we then have W(D) > W(0) for 
all 6 € (0, x). ‘The fitness of a one-parameter quantum strategy’, therefore, cannot be grester 
‘than that of a classical ESS. And a one-parameter quantum strategy cannot invade a classical 
Ess. 


6.4.2 Case (2) 
Let U(0, 4) be a two-parameter strategy from tho set (4.17). The expected payoffs are 


P(D,D)=1 
P(D,0 (0, )) = Se0s%()cos*(0/2) + sin®(@/2) 
P(U(0,#), D) = 5sin®(4) cos?(o/2) + sin?(0/2) 
P(O(0,4),0(0,6)) = 3 |eos(24) cos*(0/2)|* + 5 c08%(0/2)sin®(0/2) sin(d) — con(4) 2+ 
[sin(26) cos%(0/2) + sin?(o/2)/? (63) 


Here P(D,D) > P(O(0,4),D) if ¢ < arcsin(1/V5) and if P(D,D) = P(O(@,4),D) then 
P(D,0(6,¢)) > P(O(0,4),0(0,9)). Therefore D is an ESS if $< aresin(1/¥/5) otherwise the 
strategy (0,4) will be in position to invade D. Alternatively if most of the members of the 
Population play D ~ O(m,0) ~ meaning high frequency Fp for D — then the fitness W(D) 
will remain greater than the fitness W(0(@, ¢)) if ¢ < arcsin(1/VS). For ¢ > aresin(1/V5) the 
strategy U(0,¢) can invade the strategy D, which is the classical ESS. 

In this analysis the possession of a richer strategy by the mutants leads to invasion of D when 
@ > aresin(1/ V5). Such an invasion may seem not so unusual given the mutants exploiting 
richer strategies. But it leads to the third case when ‘quantum mutants’ have successfully 
invaded and a two-parameter strategy [ has established itself. Can now some new mutants 


“in Eisert et al's set-up one-parameter quantum strategies correspond to mixed (randomized) classical 
strategies. 
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coming up with Q ~ O(0,x/2) and invade the ‘quantum ESS"? 


6.4.3 Case (3) 


Fisert t al. (20, 46] showed that in their quantum PD the quantum strategy Q, played by both 
the players, is the unique NE. How mutants playing @ come up against 0(0, ¢) which already 
exists as an ESS? To find it following payoffs are obtained. 


P(Q,4)=3 
P(O(0,6), 9) = [3 ~ 200s*(@)]cos%(0/2) 
P(Q,0(6,6)) = [8 ~ 2c05%(¢)]c05%(0/2) + Ssin(0/2) (6.4) 


Now the inequality P(G,9) > P(O(e, 4),Q) holds for all 8 € [0,x] and # € [0,x/2) except 


condition P(Q, 4) = P(O(a, 4), @) implies @ = 0 and = 7/2. Again we have the situation 
of mutant strategy same as @ and the case is neglected. 16 is played by most of the players, 
meaning high frequency Fo for Q, then W(Q) > W(O(6, @)] for all oc (0,x] and 4 € [0,x/2). 
A two parameter quantum strategy (0,4), therefore, cannot invade the quantum ESS (i.e, 
the strategy Q ~ 0(0,x/2)). Mutants? ‘access to richer strategies, as it happens in the case @), 
does not continue to be an advantage and most of the population also have access to it Hence 
Q comes out as the unique NB and ESS of the ‘gaine, 


6.5 ESSs in Marinatto and ‘Weber’s scheme 


What happens to PD, from the point of view of evolutionary stability, when it is played via 
Marinatto and Weber's ‘scheme [52]? In our view this scheme is more ‘suitable for consideration 
of evolutionary stability in quantum regime forthe following reasons: 


+ In asymmetric bi-matrix game, played in a Population setting, players have access to two 
Pure strategies. Players can also play a mixed strategy by combining the pure strategies 
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with certain probabilities. In a similar way players in Marinatto and Weber's scheme can 
‘be-said to play a mixed strategy when they apply the two unitary operators, on the initial 
state, with a probabilistic combination. 

* Definition (2.21) of fitness of a pure strategy in evolutionary games {83} can be given 
straightforward extension in Marinatto and Weber's scheme. It corresponds to a situation 
when, in the quantum game, a player uses only one unitary operator out of the two, 

. ‘Theory of BSSs, in the classical domain, deals with anonymous players possesing a ds- 
Grote number of pure strategies, Bisert's scheme involves players possessing a continuum 
of pure quantum strategies. The concept of an ESS as a stable equilibrium is confronted 
with problems (74) when players possess a continuum of pure strategies. 


6.5.1 Example of quantum Prisoners’ Dilemma 


Assume the PD, defined by the matrix (6.1), is played with Marinatto and Weber's scheme, 
‘The initial state made available to the players is 


Win) =a|CC)+6|DD), with fal? + (oP? =1 (6.5) 


where |C) ~ |0) and |D) ~|1), Payofls to Alice and Bob can be found as 


Patova) = Sfp lal? + (1 ~)(1 ~ a) 12} + 5{n(0 ~ 4) JOP + (1 -p) lal?) 
{pa |bl? + (1 ~p)(1 ~ 9) fal?} 
Pa(p.a) = 3{pa lal? + (1 ~ p)(1~ 9) [O?} + 5(0(4 — g) fal? + 9(1 ~ P) |b?) 
{pq lb]? + (1 — p)(1 — 9) fal?} (6.6) 


where p and q are the probabilities for Alice and Bob, respectively, to act with the operator 
1. We look for symmetric Nash equilibria from the Nash inequalities while using only the 
Parameter b € © of the initial state Jy). For the state (6.5) the game is reduced to the 
classical game when |b{? = 0, i.e. when it is a product state, ‘Nosh inequalities are then 


Palbs) — Palo, 4) = @— p)(3 10? - G+} 20 
Pa(b,@) — Pa(P,a) = (@— a){318? - +1} 20 (Ca) 


Here the parameter b decides what should be the Nash equilibria of the game. Three symmetric 
equilibria arise: 


B=G=0 when 3)6(? <1 
2, p= h=1 when 3)0/?>2 

P=9= 34-1 when 1<3)b)? <2 (6.8) 
‘The first two equilibria are independent of the parameter b while the third depends on it. We 
ask which of these equilibria are evolutionary stable assuming that an equilibrium exists for 
Initial states of the form (6.5). Because the players play a symmetric game, the payoff to a 
player using / with probability p, when opponent uses it with the probability ¢, can be written. 


(psa) = S{pa al? + (1 —p)(1— 9) 6} + 5{P(1 — 9) 1 + a(t ~ ) Ja} 
{pa\b? + (1 - p)(1~ 9) lal?} (6.9) 


which can also be identified as the payoff to the p-player against the q-player. For the strategy 
pair > = q = 0 one gets P(0,0) > P(p,0) when 3]/* < 1 and P(0,0) = P(p,0) imply 3 |? = 1. 
Also P(q,q) = -a? + §(g +1) and P(0,q) = §(q +1). Now P(0,q) > P(q,q) when-¢ # 0. 
Therefore the pair p= 4 =0 is an hen 3 bi? < 1. 

For the pair p = 9 = 1 we have P(1,1) > P(p,1) which means 3|b)? > 2 if p #1. And 
P(1,1) = P(p,1) means for p #1 we have 36]? = 2. In such case P(g,q) = 2+ $(9-+7) and 
P(1,q) = §(2—q). Now P(1,q) > P(q,9) because (1-4)? > 0 for q# 1. Therefore p= 4 =1 
is an ESS when 3|8|? > 2. 


For the third pair, > = 9 = 3[b{*—1, we get P(3|0i?—1,3|0|?—1) = —36 Jo|°+-36 Jol*—5 [6/?+6. 
Also we find P(p, 3 |o?—1) = ~21 |6|*+21 |6/?—-3. Hence, the condition P(3|0|?—1,3|bl? -1) > 
P(p,3|b|? —1) holds and the pair > = 4 = 3|bl? - 1 is an ESS for 1 < 3)6f° <2. 

All three symmetric equilibria, definable for different ranges of |b®, are also ESSs. Each of 
the three sets of initial states j4in) give a unique equilibrium which is an ESS too. Switching 
from one to the other set of initial states also changes the equilibrium and ESS accordingly. 

‘A question arises here: Is it possible that a particular equilibrium switches-over between 
‘ESS' and ‘not ESS’ when the initial state changes between some of its possible choices? The 
question is relevant given the fact that transition between classical and quantum game is also 
achieved by a change in the initial state: classical payofls are obtained when the initial state is 
product state. It implies that it may be possible for a symmetric NE to switch-over between 
being ‘ESS’ and being ‘not ESS" when a game changes between its ‘classical’ and ‘quantum’ 
forms. This possibility makes the ESS concept interesting also from the point of view of 
quantum games, Because the quantum PD, in the form considered above, does not allow such 
‘8 possibility, therefore, asymmetric bi-matrix games are investigated now. 


6.5.2 ESSs in two-player two-strategy asymmetric games 


ESS for an asymmetric bi-matrix game, i.e. G= (M,N) when N % M7, is defined as a strict 
NE [32]. A strategy pair (2,j)) € 5 is an ESS of the game G if it is a strict NE: 


1. Pai) > Pa(x,i) for all x #E 
2 Pal&i) > Pald,y) for all y ¢ § (6.10) 


For example, consider BoS with the matrix: 


( (8) (17) hii) 
(9) Ba) 


where > 6 > +. It is a asymmetric game with three classical NE (52|: 


ue 


=n =0 


2 p=hel 


a-y_ 3 _B=1 

a ARS ane (6.12) 
‘The equilibria (1) and (2) are also E8S's but (3) is not because it is not a strict NE, The 
asymmetric game (6.11) played with an initial state |yin) = a|S,5;) +6|S2S2), where S; and 
5p are players’ pure classical strategies, has the following three Nash equilibria (52]: 


L fhehe=l 
2 h=h=0 

+= (@=-DlaP+ (9-910? _ (a~a) le? + (8-7) al? 
3 ome ry a= 


atB= rH 
(6.13) 
Similar to the classical case, the equilibria (1) and (2) are ESSs while (3) is not, First two 


ESSs do not depend on the parameters a and b of the initial state while the third NE does. 
Interestingly, playing BoS game with a different initial state: 


lin) = a |S,52) + b]S251) (6.14) 


changes the scene. The payoffs to Alice and Bob are: 


Patova) = p{~a(a+ 6-21) + ala)? +810)? ~ 7} + 
a{al + ala 7} +7 
Pa(p,a) = {Plat 8 ~2n) + Blal? + a6 ~ 9} + 


{610 +alal?—n} +7 (6.15) 


and there is only one NE i.e. 


+ _ Blal? +b? = _ lal? + Albi? —7 
ee ethers |! Se ete ead 


which is not an ESS. So that no ESS exists when BoS is played with the state (6.14), 

‘An essential requirement on a quantum version of a game is that the corresponding classical 
game must be its subset. Suppose for a quantum game, corresponding to an asymmetric bi- 
matrix classical game, a particular strategy pair (Z,})) is an ESS for all initial states |yn) given 
in some particular form. That is, it remains an ESS for all a and 6 when |¥ia) is given in terms 
of a and b. Because classical game is a subset of the quantum game, the strategy pair (3, )) 
must then also be an ESS in the classical game. On the other hand a strategy pair (2, )) which 


Quantization of an asymmetric classical game can thus make disappear the classical ESSs 
but it cannot make appear new ESSs, provided an ESS in quantum version remains s0 for every 
Possible choice of the parameters a and 6. However when an ESS is defined as a strict NE 
existing only for a set of initial states for which that NE exists, the statement that quantization 
can only make disappear classically available ESSs may not remain valid. Tn such a case 


quantization may make appear new ESSs definable for certain ranges of the parameters a and 
b 


To find games with the property that a particular NE switches over between ‘ESS’ and ‘not 
S' when the initial state changes between its possible choices, we now look at the following 
asymmetric quantum game: 


( (a0) (B1,A2) ) ap 


(nm) (e102) 


r 
aed Es Cobo bid 
na no 


For the initial state |¥Yin) = a|S;S;) + 6|S2S2) the players’ payoffs are: 


where 


Pa.o(o.9) = a2 {alal? + (1—p)(t 9) WP} + 
xa {(1 - a) al? +411 ~p) bP} + 
‘na {o(1 - 9) 1? +401 -p) lo} + 
na {on lo? + (1 ~p)(2 9) la} (6.19) 


‘The NE conditions are 


Pali) ~ Palo’) = 

Gp) [le or) +P (ma) -4{(-er) +(n-a)}] 20 (6.20) 
Pain’) ~ Po(},a) = 

Ga) [la (2-22) + P(r ~ an) 3 (2-02) + (Ga-an)}] 20 (621) 


Let now p = 4 =0 be a NE: 


Pa(0,0) ~ Pa(o,0) = ~p[(Ar ~o1) + 18? {(m ~ an) ~ (Ar ~01)}] 20 
(0,0) — Pa (0,0) = ~9 (12 on) +16 {(P2~ an) ~(m-on)}] 20 
(6.22) 


‘When the strategy pair (0,0) is an ESS in the classical game (i.¢. |b|? = 0) we should have 


Pa(0,0) ~ Pa(p,0) = —p(fh — 21) > 0 for all p #0 
Pa(0,0) - Pa(0, 4) = ~a(72 = 02) > 0 for all g #0 (6.23) 


It implies (9, — 01) < 0 and (72 ~ 02) <0. 
For the pair (0,0) to be not an ESS for some |b|? # 0, let take 7) = ay and fy = ay. We 


P4(0,0) ~ Pa(p,0) = ~p(0 - 1) {1 — oP} 
Pa(0,0) ~ Pa(0,4) = ~a(m» ~ 2) {1-1} (6.24) 


and the pair (0,0) doesn’t remain an ESS at |b)? = 1. A game with these properties is given by 
the matrix: 


(1.1) (4,2) es 
a G2) 


For this game the pair (0,0) is an ESS when |b? = 0 (classical game) but it is not when for 
example |b]? = }, though it remains a NE in both the cases, ‘The example shows a NE can be 
switched between ESS and ‘not ESS" by adjusting the parameters a and 6 of the initial state. 
Oppasite to the previous case, the initial states - different from the one corresponding to the 
classical game - can also make a strategy pair an ESS, An example of a game for which it 
happens is 


Sy Sy 
S ( @1) fen 
S_ \ (1,0) (1,0) 


Playing this game again via |ysn) = @|5;5;) +b|S)S2) gives the following payoff differences for 
the strategy pair (0,0): 


Pa(0,0) ~ Pa(p,0) = po)? and Pa(0,0) — Pa(0,q) = ab? (6.27) 


for Alice and Bob respectively. Therefore (6.26) is an example of a game for which the pair 
(0,0) is not an ESS when the initial state corresponds to the classical game. But the pair is an 
ESS for other initial states for which 0 < |b|? <1. 


6.5.3 ESSs in two-player two-strategy symmetric games 


‘To explore a possible relation between evolutionary stability and quantization consider the 
following symmetric bi-matrix game: 


Bob 
Sy, Sy 
iis Si [ (aa) (6,7) (628) 
S \ (nA) (69) 
which is played by an initial state: 
Win) = a [S15;) +]S252), with fal? + |b)? = 1 (6.29) 


Let Alice’s strategy consists of applying the identity operator 7 with probability p and the 
operator é with probability (1—p), on the initial state written pix in density matrix notation. 
Similarly Bob applies the operators f and 6, with the probabilities q and (1 —4) respectively. 
‘The final state is 


pyin= Sy Pr(Oa)Pr(On)[0a @ Oapimd), @ 05) (6.30) 

Gal dn 
where unitary and Hermitian operator 0 is either / or ». Pr(), Pr(Op) are the probabilities, 
for Alice and Bob respectively, to apply the operator on the initial state. The matrix pyin is 
obtained from pin by & convex combination of players" possible quantum operations. Payoff 


operators for Alice and Bob are [62] 


(PA.B)oper = 4 0|51.51) (SiSi| + B,|SiS2) (81Sal +18 |S251) (S2Sil + 5,5 1252) (Soa) 
(6.31) 
‘The payoffs are then obtained as mean values of these operators ic, Pa,a =Tr{(PA.4)operPsin)- 
Because the quantum game is symmetric with tho initial state (6.29) and the payoff matrix 
(6.28), there is no need for subscripts. We can , then, write the payoff to a p-player against a 


qplayer as P(p,q), where the first number is the focal player's move. When is a NE we find 
the following payoff difference: 


P@,B)— P,P) = (— PI lal? (8 - 5)+ 
PP (va) -3{(B-8)+(7-a)}) (6.32) 


Now the ESS conditions for the pure strategy p=0 are given as 


1 WP (B-4)-(r-@)} > B-4) 
2. If [OP (8-8) ~(y-a)} = (8-8) 
then q? {(8 - 6) +(y-a)} >0 (6.33) 


where 1 is the NE condition. Similarly the ESS conditions for the pure strategy p = 1 are 


LP {(y~@) -(6-4)} > (ya) 
2. If |6l? {(7~ a) ~ (8 - )} = (7 - a) 
then (1-9)? {(8~4)+(1-a)} >0 (634) 


Because these conditions, for both the pure strategies p = 1 and p = 0, depend on |b|’, 
therefore, there can be examples of two-player symmetric games for which the evolutionary 
stability of pure strategies can be changed while playing the game using initial state in the 
form |Yin) = a|5:S:) + 615;S2). However, for the mixed NE, given as j = KEY=B4¥ta=o), 
the corresponding payoff difference (6.32) becomes identically zero. From the second condition 
of an ESS we find for the mixed NE p the difference 


PO.a)~ Plas) = Boye 
(B-8 ~a{8-8) +(y-@)}-BP(-8) - ay}? (6.38) 


Therefore, the mixed strategy p is an ESS when {(f-6)+(y—-<a)} > 0. ‘This condition, 
making the mixed NE p an ESS, is independent ? of |0|?. So that, in this symmetric two-player 
quantum game, evolutionary stability of the mixed NE j can not be changed when the game is 
played using initial quantum states of the form (6.29). 

However, evolutionary stability of pure strategies can be affected, with this form of the 
initial states, for two-player symmetric games. Examples of the games with this property are 
easy to find, The class of games for which +y = a and (@ ~ 6) <0 the strategies p = 0 and 
p= 1 remain NE for all (/? € (0,1); but the strategy p = 1 is not an ESS when |o/? = 0 and 
the strategy p= 0 is not an ESS when ||? = 1, 


An example 


Consider the symmetric bi-matrix game (6.28) with the constants a, 8,7, satisfying the con- 
ditions: 


8,46 20 
(6-A)>0 

(y-a) 20 

(y=) < (6-8) (6.36) 


‘The condition making (p*,p") a NE is given by (6.32). For this game three Nash equilibria 
arise ie. two pure strategies p* = 0, p* = 1, and one mixed strategy p* = {Eat 
An alternative pomibility is to adjust jofPlA=HaalyPettte=e) which makes the difference 


{P6s9) ~ Pla} idesticaly ero, The mixed strategy then does not remain an BSS, However wuch ‘mutant 
dependent’ adjustinent of [tis not reasonable because the mutant strategy g can be anything in the range 0,1). 
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‘These three cases are considered below. 


Case p"=0 For the strategy p* = 0 to be a NE one requires 


P (y=2) 

P00) POO) = —— Peal --—= A] >0 sn) 
and the difference {P(0,0) — P(p,0)} > 0 when 1 > Jal" > —Get}-gy. In this range of Jal? 
the equilibrium p* = 0 is a pure ESS. However, when lal” = ---U=#}-ay we have the difference 
{P(0,0) — P(p,0)} identically zero. The strategy p* = 0 can be an ESS if 


P(0,p) — P(p,p) 
(1=n)(7—a) +16 - 6) 
=r((r-0)+(6~an for - GaP SrA} 9 easy 
that can be written as 
P00,9) ~ P(p.») = p(y - a) + (6 A)} {lal -F} > 0 (6.39) 


where 4 <F < GSaiaay when 0 < p< 1. The strategy p* = 0 can be an ESS only 
when |al? > S505 which is not possible because |al*is fixed at -—=#-ay. Therefore the 
strategy p* = 0 is an ESS for 1 > |al* > -—-#}>, and for |al* = ——G=A}-ay this NE becomes 
unstable. The classical game is obtained by taking Jal* = 1 for which p* = 0 is an ESS or a 
stable NE. However this NE does not remain stable for Jal? = ==} which corresponds 
to an entangled initial state; though the NE remains intact in both forms of the game. 


Case p*=1 Similar to the last case the NE condition for the strategy p* = 1 can be written 


a») 6p 
PUD-POD= GUA LM aaaeesa) ee (oe 


Now p* = 1 is a pure ESS for 0 < Jal? < —)_. For fal? = Lg the difference 
=a) at 


{P(1,1) ~ P(p,1)} becomes identically zero, ‘The strategy p* = 1 is an ESS when 
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P(1,2) — P(p,p) 


= (1-9-0) + 6-9) { ls + PDO 9d A) 


G-a+e-Ay S?° 


(6.41) 
It is possible only if jal’ < —-Get}-yy. Therefore the strategy p* = 1 is a stable NE (ESS) for 


0 <|a)? < p-SeAh-gy- It is not stable classically (i.e. for |a|* = 1) but becomes stable for an 
‘entangled initial state. 


Case pt = Hflel=ta-ail” I case of the mixed strategy: 


= GA 
r EB) (6.42) 
the NE condition (6.32) turns into 
P(p",p") — P(p,p*) =0 (6.43) 
‘The mixed strategy (6.42) can be an ESS if 
P(p",p) ~ P(r.) 
= (9) [-laP (6) +167 (9a) +7{(5~9)-(r-a)}] >o 
(6.44) 


for all p # p*. Write now the strategy p as p= p* +A. For the mixed strategy (6.42) the payoff 
difference of the Eq. (6.44) is reduced to 


P(",2) - P(p.p) = — 4? {(6- 8) -(y-2)} (6.45) 


Hence, for the game defined in the conditions (6.36), the mixed strategy p* = -#)eh -(a-a) 
cannot be an ESS, though it can be a NE of the symmetric game. 


um” 


It is to be pointed out that above considerations apply when the game is played with the 
initial state (6.29). 

‘To find examples of symmetric quantum games, where evolutionary stability of the mixed 
strategies may also be affected by controlling the initial states, the number of players are now 
increased from two to three. 


6.5.4 ESSs in three-player two-strategy symmetric games 
In extending the two-player scheme to a three-player’ case, we assume that three players A, B, 
and C play their strategies by applying the identity operator / with the probabilities p,q 


and r respectively on the initial state jy). Therefore, they apply the operator @ with the 
probabilities (1 — p),(1—q) and (1 ~r) respectively, The final state becomes 


Prm= Y) Pr(Oa)Pr(On)Pr(0c) [On @0n@Ucpn,@0,e0!) (6.46) 
Calon 


where the 8 basis vectors are |$(5j5,), for i,j,k = 1,2, Again we use initial quantum state 
in the form Yin) = a|5;S151) +b|S25252), where |uj® + JO)? = 1. It is a quantum state in 
2.@2@2 dimensional Hilbert space that can be prepared from a system of three two-state 
‘quantum systems or qubits. Similar to the two-player case, the payoff operators for the players 
A, B, and C can be defined as 


(PA.B.C)oper = 

15 ism |51S151) ($1$15)| + a, Baym |S25151) ($2545) + 

435 Bas Ms 1515251) (S1$25,| + ex Bay na 1515152) (515, S4] + 

2%, 515 |$15282) ($1 $253] + a0, 6,10 1525152) (S25,So] + 

41, Bry tt |S28251) (S2S251| + cy, Os, 1h |S282S2) (S252) (6.47) 


% 


where a, (i,m for 1 <1-<8 are 24 constants of the matrix of this three-player game. Payoffs 
to the players A,B, and C are then obtained as mean values of these operators 


Papclrrgr) = Tr[(Pa,8.c)operP yin) (648) 


Here, similar to the two-player case, the classical payoffs can be obtained by making the initial 
‘quantum state unentangled and fixing |b? = 0. To get a symmetric game we define P,(z, y,z) 
1s the payoff to player A when players A, B, and C play the strategies x, y, and z respectively. 
‘With following relations the players’ payoffs become identity-independent. 


Paley. 2) = Pa(z, zy) = Paty,2,2) 
= Pa(2,2,¥) = Po(y,2,2) = Po(z,y.z) (6.49) 


‘The players in the game then become anonymous and their payoffs depend only on their strate- 
gies. The relations (6.49) hold with the following replacements for i, and nj: 


Am Foy Pyar = fy—a3 
Ps—ag Paras fray fav as 
Mm me; mom Ma 
Ts05 05 my OS (6.50) 


Also, it is now necessary that we should have 


4 = 07, 03 = 0% (6.51) 


A symmetric game between three players, therefore, can be defined by only six constants of the 
Payoff matrix, These constants can be taken as a}, 02,03, a5, ag, and ag. Payoff to a p-player, 
when other two players play g and r, can now be written as P(p,q,r). A symmetric NE p is 
now found from the Nash condition P(p,p,) — P(p,P,p) > 0 ie. 


~ pf (1-200? (0 + - 20) 
2 {WP (o-+w- 20) -w+n} + {uP (o+w)}] 20 (6.52) 


where 


(1 - a) =o 
(a3 ~a5)=7 
(as —a3) = (6.53) 


‘Three possible NE are found as 


{(o-n)-107 (o+s—20)} + VIP GPO Pow) 
OF Koto—20) 
i,=0 (654) 


iat 


A= 


It is observed that the mixed NE p, makes the difference {PG.3.#) -P.?.3)} identically 
zero and two values for p, can be found for a given ||. Apart from p, the other two NE (ie. Bp 
‘and ,) are pure strategies. Also now p, comes out » NE without imposing further restrictions 
on the matrix of the symmetric three-player game. However, the pure strategies , and py can 
be NE when further restriction are imposed on the matrix of the game. For example, }; can be 
a NE provided o > (w+c) |b)? for all |b? € (0, 1]. Similarly >, can be NE when w < (w+) |b”. 

Now we address the question: How evolutionary stability of these three NE can be affected 
while playing the game via initial quantum states given in the following form? 


lin) = @|S1.5;51) + b|S2S2S2) (6.55) 


For the two-player asymmetric game of BoS we showed that out of three NE only two can be 
evolutionary stable. In classical evolutionary game theory the concept of an ESS is well-known 
[75, 76] to be extendable to multi-player case. When mutants are allowed to play only one 
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strategy the definition of an ESS for the three-player case is written as [75] 


1. P(p.p.p) > P(a,p.7) 
2. If P(p,p.p) = Pla,n,p) then P(p,q,p) > P(a,%.P) (6.56) 


Here p is a NE if it satisfies the condition 1 against all q # p. For our case the ESS conditions 


for the pure strategies }iy and py can be written as follows. For example py = 0 is an ESS when 
1 ofp)? >wial* 
2. If [dj =wlal? then — ng?({al* - lb?) > 0 (6.57) 


where 1 is NE condition for the strategy jy = 0. Similarly jy = 1 is an ESS when 


1. eal? > w/b? 


2. Ifo fal? =u bf? then n(1 — 4)?(lal® — 16/2) > 0 (6.58) 


and both the pure strategies py and ji; are ESSs when al? = |bj. The conditions (6.58) can 
also be written as 


1. o> (wte) lol? 


aw =9) 


=|? 
2. Wo = [bP (w-+o) then 


>o (6.59) 


For the strategy p, = 0 the ESS conditions (6.57) reduce to 


1 w<(wta) of? 


2. If w= [BP (w-+a) then wo >0 (6.00) 


Examples of three-player symmetric games arc easy to find for which a pure strategy is a NE for 
the whole range ||? € (0,1, but it is not an ESS for some particular value of |#|*. An example 
of a class of such games is for which 7 = 0, w <0, and 7) < 0. In this class the strategy p) = 0 
is a NE for all |b)? € (0, 1] but not an ESS when |b? = 1. 

Apart from the pure strategies, the mixed strategy equilibrium j, forms the most interesting 
case. Tt makes the payof diference {P(i,pi,th) ~P,Prti)} identically zero for every 
strategy p. The strategy py is an ESS when { P(pi, 4,71) ~ P(q,9,t%)} > 0 but 


P(i.0,91) ~ Pla..7%) 


= £1 — a) {Co + 0)? = (2n)?) 1 (2 — 16?) + (9? ow) (6.1) 


Therefore, out of the two possible roots (7); and (7)2 of the quadratic equation’; 


Br (1 2)0?)(0 +0 — 2n)+ 
2s {I6? (e+ 0-29) -w +n} + {w-1H? (0 +u)} =0 (6.62) 


only (7;); can exist as an ESS. When the square root term in the equation (6.61) becomes 
zero we have only one mixed NE, which is not an ESS. Hence, out of four possible NE in this 
three-player game only three can be ESSs. 

An interesting class of three-player games is the one for which 7? = ow. For these games 


the mixed NE are 
(w-n)- +w—2%)} = lal [blo - 
gud 1) — bP (oe +w a} fal wl a 
(1-2|0/°)(@ + w — 2n) 
and, when played classically, we can get only one mixed NE that is not an E 


all [0/?, different from zero, we generally obtain two NE out of which one can be an ESS, 
Similar to the two-player case, the equilibria in a three-player symmetric game where quan- 


These roots make the dierence {P(..81)— P(@.aif)}sreater than and less than aro, respectively. 


i) 


tization affects evolutionary stability, are the ones that survive for two initial states, one of 
which is unentangled and corresponds to the classical game. Suppose p; remains a NE for 
|b)? = 0 and some other non-zero |bl?. It is possible when 


(oa) - 1) = (6.64) 


Alternatively the strategy j = } remains a NE for all {éj? € [0,1]. It reduces the defining 
quadratic equation (6.62) for p; to 


otu+2=0 (6.65) 


and makes the difference { P(i,, 0,31) — P(g,9.#i)} independent of jo. "Therefore the strategy 
p= 4, even when it is retained as an equilibrium for all {6[? € (0, 1], cannot be an ESS in only 
one version of the symmetric three-player game. For the second possibility ¢ = w the defining 
equation for p; is reduced to 


Ce a ee (688) 


for which 


PUivei)~ Plea) = 210k oP [oP = 3] vP=aF (een) 


Here the diference {P(Fi,4.f1)  P(@.4.1i)} still depends on J? and becomes zero for |? = 
12. 

Hence, for the class of games for which ¢ = w and 7 > o, one of the mixed strategies 
(Pia. (Pi)2 remains a NE for all |b(* € [0,1] but not an ESS when |b|? = 1/2. In this class of 
three-player quantum games the evolutionary stability of a mixed strategy can, therefore, be 
changed while the game is played using initial quantum states in the form (6.55). 


6.6 Quantum Rock-Scissors-Paper game 


Long played as a children’s pastime, or as an odd-man-out selection process, the Rock-Scissors- 
Paper (RSP) is a game for two players typically played using the players’ hands. The players 
opposite each others, tap their fist in their open palm three times (saying Rock, Scissors, Paper) 
and then show one of three possible gestures. The Rock wins against the scissors (crushes it) 
but looses against the paper (is wrapped into it). The Scissors wins against the paper (cuts 
it) but looses against the rock (is crushed by it). The Paper wins against the rock (wraps it) 
but looses against the scissors (is cut by it). The game is also played in nature like many other 
games. Lizards in the Coast Range of California play this game [77] using three alternative male 
strategies locked in an ecological never ending process from which there seems little escape. 


6.6.1 Rock-Scissors-Paper in a slightly modified version 


In a slightly modified version of the RSP game hoth players get a small premium ¢ for a draw. 
This game can be represented by the payoff matrix: 


RSP 
R(-e 1 -1 
S|] -1-e 1 (6.68) 
P\i1 -1 -e 
where -1 <€ <0. The matrix of the usual game is obtained when ¢ is zero. 


6.6.2 Nash equilibrium and ESS in Rock-Scissors-Paper game 


One cannot win if one's opponent knew which strategy was going to be picked. For example, 
picking Rock consistently all the opponent needs to do is pick Paper and s/he would win. 
Players find soon that in case predicting opponent's strategy is not possible the best strategy 
is to pick Rock, Scissors, or Paper at random. In other words, the player selects Rock, Scissors, 
or Paper with probability of 1/3. In case opponent's strategy is predictable picking a strategy 
at random with a probability of 1/3 is not the best thing to do unless the opponent is doing 
the same [33]. 
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Analysis [32] of the modified RSP game of matrix (6.68) shows that its NE consists of playing 
cach of the three different pure strategies with a fixed equilibrial probability 1/3. However it is 
not an ESS because ¢ is negative. 

‘Here we want to study the effects of quantization on evolutionary stability for the modified 
RSP game. The game is different, from others considered earlier, because classically each player 
now possesses three pure strategies instead of two. A classical mixed NE exists which is not an 
ESS. Our motivation is to explore the possibility that the classical mixed NE becomes an ESS 
for some quantum form of the game. 


6.6.3 Quantization of Rock-Scissors-Paper game 


Using simpler notation: R ~ 1, S ~2, P ~ 3 we quantize this game via Marinatto and Weber's 
scheme [52]. We assume the two players are in possession of three unitary and Hermitian 
operators £,C and D defined as follows. 


i=, ¢n=s), d51)=2) 
ip=2), p)=—), Se)=n) 
ip)=1), CB)=n), 51) =B) (6.69) 


where Ct = G = G-! and Dt = D = D~ and [is the identity operator. 
Consider a general two-player payoff matrix when each player has three strategies: 


ae a 
1 ( (@n,Ai) (2A) (ais,Ais) 
2} (ax,Pa) (a22,P2) (a2, 2s) (6.70) 


3 \ (@x,Am) (32,62) (a3, Ass) 
where aij and fay are the payoffs to Alice and Bob, respectively, when Alice plays i and Bob 
plays j and 1 < i,j < 3. Suppose Alice and Bob apply the operators C, D, and / with the 
probabilities p, i, (1—p~ pr) and 9, ar, (1 @~m) respectively The initial state ofthe game 


is pin: Alice's move changes the state changes to 


Pon = (1—p—Pr)lapinll, + PCapinCh + 1 DapinD), (en) 


‘The final state, after Bob too has played his move, is 


‘it = (1-¢~a)lapenll, + ¢CopnCh + 1Dopndy (6.72) 


This state can be written ss 


$f =(1-p—m)-9- a) {14 @ Lopnl', @ Ty} + v(t -9- 0) 
{64 fornd' @ 15} +2101- 9-0) {Da © opm), @ fh} + 
(= p- ra {ta@ Cnral 6h} +0 {Cr Cormac och} + 
n10 {Da Cand), @C}} + (1-p-pr)n {Ia @ Doria! @D}} 
+pn {Cr @ Dapatl @ Db} + mn {D4 Dermb), @ Db} (6.73) 


‘The nine basis vectors of initial quantum state with three pure classical strategies are |ij) for 
4,j = 1,2,3. We consider the initial state to be a pure quantum state of two qutrits ie. 


Win) = > cylif), where S> fel? =1 (6.74) 
igalaa ijetaa 
‘The payoff operators for Alice and Bob are (52) 


(PA.B)oper = (ee, )ax 111) (11) + (ca, 8) [12) (12) + (a4 B)aa 113) (13] + 
(ex, A)zx 122) (21| + (0 )za |22) (22] + (a, Bas 128) (23) + 
(c,)su 31) (32| + (4, 3a (32) (82| + (a, B)33 193) (83) 
(6.75) 


‘The players’ payoffs are then 


Paw = T{{(Paslene) Bf] (6:76) 


Payoff to Alice, for example, can be written as 


P, = oot (6.77) 


where T is for transpose, and the matrices ®, 9, and T are 


@=[ (1-p-p)(-q—m) pi-a—m) m(l-9-a) 
Q-p-m)a pm mg (-p-pn mm mo! 
Tela a2 a3 on a2 om om on oy] 
lel? eal? leal? Joa? Jere? Jens? Jen? Jee? Jel? 
leaf? lesal? eal? Jeaul® era? leas!? leul® Jeia!® lel? 
lenl? lezal? fees? leusl® Jena!” Jeaal® fea fesal® fesl? 
leral? eval? feu? Jeal® Jee? foul? fel? Jes? Jenl? 
=| leas!” lesl* eaul* femal? Jor? lew? Jel? Jel? lenf? 
lemal? lez!” foul? leasl® Jena feral? leas? feel? lean? 
leral® Jeusf? eval? feaal® fenl® Jeas!? lesal? Jesu? leaal® 
lesal? leas? eaal? Jeoal® fen!? Jers? feral? Jeu! Jeasl® 
femal? Jenl® Jel? Jers? Jeul® fel? evel? foul? Jel? 
(6.78) 


‘The payoff (6.77) corresponds to the matrix (6.70). Payoffs in classical mixed strategy game 
can be obtained from Eq. (6.76) for the initial state fx) = |11). The game is symmetric when 
a4; = Aji in the matrix (6.70). The quantum game played using the quantum state (6.74) is 
symmetric when |cis|? = |cyi[? for all constants cj in the state (6.74). These two conditions 
together guarantee a symmetric quantum game. ‘The players’ payoffs P4, Pg then do not need 
‘8 subscript and we can simply use P(p,q) to denote the payoff to the p-player against the 


¢rplayer. 


‘The question of evolutionary stability in quantized RSP game is addressed below. 


6.6.4 Consideration of evolutionary stability 


Assume a strategy is defined by a pair of numbers (p,p1) for players playing the quantized 
RSP game, These numbers are the probebilities with which the player applies the operators 


@ and D. ‘The identity operator / is, then, applicd with probability (I~ p ~ 3). Similar to 


the conditions 1 and 2 in Eq. (2.20), the conditions making strategy (p*, pj) an ESS'can be 


written as (29, 32) 


1. PAP. pi)so" Pi)} > PLP), PPI) 
2. if P(p*spt)s(P" PD} = PU (P19) (P* PAD} then 
PA{(p", pi), (PP1)} > PLC Pr) (Pom) 


‘Suppose (p*, pj) is a mixed NE then 
ap op 
re | @-r+5~1 , orm} 20 
ti rene Om rene 
Using substitutions 


foul? lent? = 41, onl? -lenl? = 4s 
feral? -lesal? = Aa, feral? ~leral? = 2 
Jeuaf?— lel? = Aa, Joni? — lea!” = 3 


FF peg = #1 ~ a) (ou +e) - (orton) + 
Pi(O1 ~ 4s) (an +2) ~ (axa +an)) ~ 


Ax (an ~ 31)  Sa{ars ~ 433) - Salone ~ 032) 


(6.79) 


(6.80) 


(6.81) 


(6.82) 


Fe leer =9'(A5 Ai) {(ou+on) ~ (aus +an))+ 
PnP 
Pi(03~ 4%) ((au-+02) - (on + en)} + 


4) (ns — a1) + Ba(ana - a2) + Dg(ans ~ as) 


For the matrix (6.68) the equations (6.82, 6.83) can be written as 


FF | pore = Ai (-26" = (8+ Op} (Lt 0} + 
pean 
2 (20 + (1-0) +40 (8+ of -2} 
Fe pee = Ai lv -9 +a + 0-9) — 
lo 


Da {2epi ~ (1+6)} +43 {(8 ~ dp" - 2} 


(6.83) 


(6.84) 


(685) 


‘The payoff difference in the second condition of an ESS given in the Eq. (6.79) reduces to 


P(@*,Pi)s 2.) - PU.Pr),@,P)} 

= (p* — p)[— Ar (2ep+ (3+) — (1+ 0)}+ 
Da {2ep+ (1-0) + As{(3 + pr — 2+ 
Gi p- 4) {8 -op- 2m - (1-9)}- 
4p (2ep1 ~ (1+ 6)} + A5(3- op - 2}] 


With the substitutions (p* — p) = x and (pf — p) = y the above payoff difference is 


(6.86) 


PEGI), .1)} — Ple.m)s(,71)} 
= Air {2ex + (3+ oy} — Da(2ex”) - Aszy(3 + 6)- 


Diu Rey - (3-62) + O30q7) - O32y(3- 0) (687) 
provided 
oP oP 
® Vee =0 on | page =0 (6.88) 


‘The conditions in Eq. (6.88) together define the mixed NE (p*, pt). Consider now the modified 
RSP game in classical form obtained by setting |c1|” = 1. ‘The Eqs. (6.88) become 


—2ep* ~ (+ 3)p} + (€+1) = 0 
(-€+3)p" ~ ep} + (e-1) =0 (6.89) 


and p* = pj = | is obtained as a mixed NE for all the range -1 < «<0. From Eq. (6.87) we 
get 


PA(p*, Pi), 1)} — P{(P,71), (P71) 
= (2? +97 + ay) = e{(z+y)? + (22 +47)} <0 (6.90) 


In the classical RSP game, therefore, the mixed NE p* = pj = } is a NE but not an ESS, 
because the second condition of an ESS given in the Eq. (6.79) does not hold. 
Now define a new initial state as 
Wea) = 3 (112) + 21) + 18) +[31)) (691) 


and use it to play the game, instead of the classical game obtained from |¥in) = |11). The 
strategy p* = pj = } still forms a mixed NE because the conditions (6.88) hold true for it, 
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However the payoff difference of Eq. (6.87) is now given below, when —1 <¢ <0 and x,y #0: 


PLP", Pi)s(P.p2)} - PLP), (.1)} 
=-e{(e+ 9? +@+y)} >0 (6.92) 


‘Therefore the mixed NE p* = pj = }, not existing as an ESS in the classical form of the RSP 
game, becomes an ESS when the game is quantized and played using an initial (entangled) 
quantum state given by the Eq. (6.91). 

Note that from Eq. (6.76) the sum of the payoffs to Alice and Bob (Pa + Pa) can be 
obtained for both the classical mixed strategy game (i.e. when |¥in) = |11)) and the quantum 
game played using the quantum state of Eq. (6,91). For the matrix (6.68) we write these sums 
a5 (Pa+ Poa and (Pa + Pa)gu for classical mixed strategy and quantum games respectively. 
We obtain 


(Pa+ Pada = ~2e{(1~ p—m)(L- 4-1) + rim + Pa} (6.93) 


(Pat Pau == {i+ Poa +e} (6.94) 
In case ¢ = 0 both the classical and quantum games aro clearly zero sum. For the slightly 


modified version of the RSP game we have —1 <«¢ <0 and both versions of the game become 
‘non zero-sum. 


6.7 Stability of a mixed Nash equilibrium 


In a classical symmetric bi-matrix game, played in an evolutionary set up involving a population, 
all the members of the population are indistinguishable and each individual is equally likely to 
face the other. In such a set-up individuals interact only in pair-wise encounters. 

Assume a finite set of pure strategies (1, 2,....n} is available to each player. Tn one pair-wise 
encounter let a player A receives a reward ayy by playing strategy i against another player B 
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playing strategy j. In symmetric situation the player B, then, gets aj; as a reward. The value 
‘ay is an element in the n x n payoff matrix M. We assume that the players also have an 
option to play a mixed strategy. It means he/she plays the strategy i with probability p; for all 
i= 1,2,...7. A strategy vector p, with components pi, represents the mixed strategy played by 
the player. In standard notation an average, or expected, payoff for player A playing strategy 
P against player B playing q is written as P(p,q) [78]: 


P(p,q) = )oynay = P™Mq (6.95) 


where T is for transpose. 

In evolutionary game theory mixed strategies play a significant role. The well-known Bishop- 
Cannings theorem (BCT) [79] describes an interesting property of mixed ESSs in symmetric 
bi-matrix games. Introducing the concept of support of an ESS is helpful to understand the 
BCT (78, 80}. Suppose a strategy vector p = (pi) is an ESS. Its support S(p) is the set $(p) = 
{i: pi > 0}. Hence the support of p is the set of pure strategies that can be played by a p- 
player. BCT states that if p is an ESS with support I and r # pis an ESS with support J, then 
ID J. Por bi-matrix games the BCT shows that no pure strategy can be evolutionary stable 
when a mized ESS exists [78]. Naturally one, then, asks about the classical pure ESSs when a 
switch-over to a quantum form of a classical symmetric bi-matrix game also gives evolutionary 
stability to a mixed symmetric NE. 

Following the approsch developed for quantum RSP game, we now consider a general form 
of a two-qubit initial quantum state. Our results show that for this form of the initial quantum 
state, the corresponding quantum version of a bi-matrix game can give evolutionary stability 
to a mixed symmetric NE when classically it is not stable. It is interesting to observe that by 
ensuring evolutionary stability to a mixed NE in a quantum form of the game, the BCT forces 
out the pure ESSs present in classical form of the game. 

The payoff to a player in the quantized version of the RSP game can also be written in 
similar form to (6.95), provided the matrix M is replaced with 2 matrix corresponding to 
quantum version of this game. 

For example, Alice's payoff, who plays the strategy p (where p™=[(1-p—m) mi Pl) 


against Bob who plays the strategy q (where q”=[(L- 9-41) 1 4]), can be written as 


where the matrix w is given by 


‘and the elements of w are given by the following matrix equation 


Pa(p,a) = P"wa 


wn we wis 


w=] om om wns 


wn wm ws 


(wu un us on om va ux on on) 


=(on 
leul? 
leva)? 
leaal? 
leaf? 
lenal? 
lea? 
les!” 
leaal? 
lessl? 


‘The matrix (6,97) reduces to its classical form (6.70) by fixing Jen|? = 1. 


ou a3 on om en on on am )¥ 


lal? leas? 
len? fea? 
lel? len! 
len? loxsl* 
loal? lozal* 
lel? lenl? 
leval® leasl? 
leas! lesal? 
leasl? esnl? 


leaf? fea lenal? Jeatl? 
loaf? len? lez? Jeaal® 
leas!? Jonsl? lens!?  Jesal® 
leu? fez? lenal? len? 
leval? Jeus!® Jeral? lezal® 
les? Jes! len? lexi? 
featl? level? eoal® feu? 
leva? Jeul? Jeval? leval? 


leval? 
les? 
lesa)? 
lena!” 
leas)? 
lel? 
eral? 


len? 


less|? 
fesal? 
len? 
lenal? 
lena? 
len/? 
leasf? 
el? 


fexal? fess? Jen? leis! lera!? feu? 


(6.96) 


(6.97) 


(6.98) 


In a symmetric game the exchange of strategies by Alice and Bob also exchanges their 
respective payoffs. The quantum game corresponding to the matrix (6.70), when played using 


the initial quantum state of Eq. (6.74), becomes symmetric when 


leis? = leyl? for i # j (6.99) 


‘The two-player quantum game, with three pure strategies, gets a form similar to a classical 
matrix game. The payoff matrix of the classical game, however, is replaced with its quantum 
version (6.97). Also the matrix (6.97) now involves the coefficients qj of the initial quantum 
state (6.74). 

To reduce the above mathematical formalism to two-player, two-strategy quantum game 
lets fix m1 = qr = 0, that is, both players do not use the operator B at all, and apply only the 
operators C and / on the initial quantum state. Payoff to the player who plays the strategy 
vector p (where p7=[1—p p]) against the player who plays the strategy vector q (where 
a"=[1—q ql) can again be written as P(p,q) = p™wa. Nevertheless, w is reduced to its 


simpler form; 
wal os (6.100) 
ws URS 
where elements of the matrix are 
on lel? leis? leon? eas!) (ons 
ws |_|} lel? lenf* Jesal® lea? | | ois (e.0) 
on leat? lesa? Jeunl® fas? | | am 
ws feoal? Jeol? leual® Jeur!® } \ oa 


It becomes a bi-matrix game played with the initial quantum state (6.74). The available pure 
strategies are 1 and 3 only and the terms with subscripts containing 2 disappear. Take x = 1—p 
and y = 1 ~ 9, $0 that = and y are probabilities with which players apply identity operator 
oon the initial state |Yiqi). The strategy vectors p and q can now be represented only by the 
numbers x and y, respectively. Payoff to a z-player against a y-player is then obtained as 


P(x) = pTwq =z (uniy + wna(t ~ y)} + (12) {wry ters(1—»)} (6.102) 


Suppose (x*,2") is a NE, ie. 


1 


P(z*,2*) ~ P(z,z*) 
= (2* ~ 2) {2"(on — ors ~ war +033) + (wis — w3s)} > 0 (6.103) 


for all x € [0,1]. The mixed strategy 2* = 2¢ = (wy3 — o13)/(wn1 — wg — wai +3) makes the 
Payoff difference P(z*,2*) — P(z,2*) identically zero. The subscript q is for ‘quantum’. Let 
Ox=2*—zx then 


Plaqy2) — P(z,2) = —(A2)* (wn — wns ~ ni + ws9) (6.104) 


Now ay is an ESS if {P(23,x) — P(z,z)} > 0 for all x # x, which leads to the requirement 
(on ~ est — rs +43) <0, 

‘The classical game corresponds when |o;|* = 1 and it gives uny = a1, W13 = ars, 3} = a1, 
‘and w33 = a3, in accordance with the Eq. (6.98). In case (ay) - a3 ~ a9, + a33) > 0, the 
mixed NE of a classical game, i.e. 2* = 22 = (a33~a13)/(a11 — 213 ~ 31 +033), is not an ESS, 
Here the subscript c is for ‘classical’. Since we look for a situation where evolutionary stability 
of a symmetric NE changes — while the corresponding NE remains intact — in a switch-over 
of the game from its classical to quantum form, lets take 


(6.105) 


saying that the classical NE 2 is also a NE in quantum form of the game. Now from the matrix 
in the Eq. (6.101) 


(wr = oy, = ns + 9) 
= (au ~ a3 ~ a3: + 433)(leusl? feral? ~ len + leasl?) (6.106) 


and 


sa is = lenl? (as — a3) + feral? (a1 ~ an)+ 


leas? (rs — 033) + legal? (en — 051) (6.107) 


A substitution from Eqs. (6.106,6.107) into the Eq. (6.105) gives ass — a13 = a1: — a, and 
this leads to xz = 25 = 1/2. Therefore the mixed strategy z* = 1/2 remains a NE in both 
the classical and quantum form of the game. Consider this mixed NE for a classical game with 
(au ~ a13 ~ 31 + 439) > 0, a condition that assures that it is not an ESS. The Eq. (6.106) 
shows an interesting possibility that one can have (wi) — wx — wis +wys) <0 if 


(enl? + lesa”) < (lef? + lest?) (6.108) 


In other words, the evolutionary stability of a mixed strategy, which is a NE in both classical 
and quantum. versions of the game, changes when the game switches-over between its two forms. 
‘To have a symmetric game also in its quantum form we need |¢y3|" = |esi|*, which reduces the 
inequality (6.108) to $(leu|? + less\*) < leial®. 

Hence, a quantum version of a symmetric bi-matrix classical game with the matrix: 


(au,an) (13,03) (6.109) 
(esis) (033,33) 


can be played if both the players have access to two unitary and Hermitian operators and the 
game starts with a two-qubit quantum state of the form: 


Won) = SO clés) (6.110) 
sjela 


where 5 Jey)? = 1. In case ogy ~ 013 = oui — a the mixed strategy 2* = 1/2 is not an 
igahs 

ESS in the classical game if (a33 — a3) > 0. Nevertheless, the strategy z* = 1/2 becomes an 

ESS when fers)? + lesal* < leral* + leas[*. In case (a3 — crs3) <0 the strategy 2* = 1/2 is an 


ESS classically but does not remain so if again Jou[? + lexa{* < Jersl? + lenl*. Now suppose 


leisl? = leaf? =0, the Eq. (6.106) reduces to 


(ou — ong — war +03) = (ax — 013 — a + 033) (6.111) 


It is observed from the equation (6.111) that if a quantum game is played by the following 
simple form of the initial quantum state: 


Wins) = ens [11) + 633 (33) (6.112) 
then it is not possible to influence the evolutionary stability of a mixed NE. 


6.7.1 Discussion 


Mixed ESSs appear in many games of interest that are played in the natural world. The exam- 
ples of the RSP and Hawks and Doves games are well known from evolutionary game theory. 
‘The Bishop-Cannings theorem of evolutionary game theory does not permit pure ESSs when a, 
mixed ESS exists in a population engaged in a bi-matrix game. The possibility of changing evo- 
lutionary stability of » pure symmetric NE has been considered earlier with normalized states 
of the form |¥iz) = 11 1,1) +ez2|2,2). Using such initial states, however, cannot change evo- 
lutionary stability of a mixed strategy. In this section, following an approach developed for the 
‘quantum RSP game, we play a bi-matrix game with a general two-qubit pure initial quantum 
state. Such state allows changing evolutionary stability of a mixed NE. For a bi-matrix game a 
symmetric mixed NE is found that remains intact in both the classical and quantum versions 
of the game. For this mixed NE conditions are then found allowing the change of evolutionary 
stability with a switch-over of the game, between its two forms, one classical and the other 


quantum. 


6.8 Equilibria of replicator dynamics in quantum games 
6.8.1 Introduction 


Maynard Smith and Price [29] introduced the idea of an ESS essentially as a static concept. 
Nothing in the definition of an ESS guarantees that the dynamics of evolution in small mu- 


tational steps will necessarily converge the process of evolution to an ESS. In fact directional 
evolution may also become responsible for the establishment of strategies that are not evolu- 
tionary stable [36]. 

‘What are the advantages involved in a dynamic approach towards theory of ESSs? A 
stated reason [82] is that dynamic approach introduces structural stability into game theory. 
Historically Liapunov provided a classic definition of stability of equilibria for general dynamical 
systems. This definition can also be adapted for the stability of a NE. A pair of strategies (p", 9") 
is Liapunov stable when for every trajectory starting somewhere in a small neighborhood of 
radius ¢ > 0 around a point representing the pair (p*,q*) another small neighborhood of radius 
5 > 0 can be defined such that the trajectory stays in it. When every trajectory starting in a 
small neighborhood of radius o > 0 around the point (p*,q*) converges to (p*,9") the strategy 
pair (p*,q*) becomes an attractor. “Trajectories are defined by the dynamics underlying the 
game. 

‘Taylor and Jonker (34] introduced a dynamics into evolutionary games with the hypothesis 
that the growth rate of those playing each strategy is proportional to the advantage of that 
strategy. This hypothesis is now understood as one of many different forms of replicator dy- 
namics [36, 83]. In simple words assume that p; is the frequency (i.e. relative proportion) of 
the individuals using strategy i and p, where p™ = [p,, p2-p;---Pu] and T is the transpose, is a 
vector whose components are the frequencies with En =1. Let A(p) be the average payott 
for using i when the population is in the state p. Let P = Sip;P; be the average success in the 
population. The replicator equation is, then, written as [84] 


& =p P(p)— P) (6.113) 


where the dot is derivative with respect to time. Let the payoff matrix be A = (a;s) with a; 
being the average payoff for strategy i when the other player uses j. The average payoff for the 
strategy i in the population (with the assumption of random encounters of the individuals) is 
(Ap); = anpi +. + dinPn and the Eq. (6.113) becomes 


= pi((Ap),- P™ Ap) (6.114) 


‘The population state is then given as a point in n simplex A [85]. The hypothesis of Taylor 
and Jonker 34] gives a flow on A whose flow lines represent the evolution of the population. 
In evolutionary game theory it is agreed [32] that every ESS is an attractor of the flow defined 
on A by the replicator equation (6.113), however, the converse does not hold: an attractor is 


not necessarily an ESS. 

‘Our motivation is to find how equilibria of replicator dynamics are affected when a matrix 
game played by a population is quantized. It should, of course, be sensitive to quantization 
procedure selected for the matrix game. We find the effects when the matrix game is quantized 
via Marinatto and Weber's scheme. 


6.8.2 Equilibria and attractors of replicator dynamics 
Early studies about the attractors of replicator dynamic by Schuster, Sigmund and Wolff (86, 
87] reported the dynamics of enzymatic actions of chomicals in a mixture when their relative 
proportions could be changed. For example, in the case of a mixture of three chemicals added 
in a correct order, such that corresponding initial conditions are in the basin of an interior 
attractor, it becomes a stable cooperative mixture of all three chemicals. But if they are 
added in a wrong order the initial conditions then lie in another basin and only one of the 
chemicals survives with others two excluded. Eigen and Schuster (86, 87, 27] also studied 
resulting dynamics in the evolution of macromolecules before the advent of life. 

Schuster and Sigmund [88] applied the dynamic to animal behavior in BoS and described 
the evolution of strategies by treating it as a dynamical system. They wrote replicator Eqs. 
(6.114) for the payoff matrix: 


Y Ye 


x ( (orsb) (@r2,ba1) ) 


Male's strategy (6.115) 


Xa \ (aa,b:2) (e22,b22) 


where a male can play pure strategies X;, Xz and a female can play pure strategies Yi, Y2 
respectively. Let in a population engaged in this gamo the frequencies of X; and X2 are p, and 
Pa respectively. Similarly the frequencies of Y; and Y2 are q; and q respectively. Obviously 


6 


Atp=nta=1 
where p; > 0, qi > 0, for i= 1,2 (6.116) 


the replicator equations (6.114) for the matrix (6.115) with conditions (6.116) are, then, written 
as 


B=P(L—p) {4(0n ~ a2 — 001 + 0x2) + (012 — 0m)} 
4 = (1 ~ 4) {p(brs — bia — bai + bra) + (brz — boa)} (6.117) 


where p, = p and 9, = q. These are Lotka-Volterra type equations describing the evolution of 
two populations identified as predator and prey [80]. Schuster and Sigmund [88] simplified the 
problem by taking 


ay = by = an = ty =0 
@2=a oy =b and 
base by=d (6.8) 


which does not restrict generality of the problem and the replicator Eqs. (6.117) remain similar. 
Payoff to the male Pas(p, ) and to the female Pp(p,q), when the male plays X; with probability 
P (he then plays X2 with the probability (1 —p)) and the female plays Yj with the probability 
q (she then plays Y2 with the probability (1—)) are written as [30] 


Pu(p,) = p™Ma 
Pe(p,q) =a" Fp (6.119) 


where 


poe 78 | ok pan) (6.120) 
am ax boy boa 


o-( i ); and «-( % ) (6.121) 
l-p 1-q 
and T is for transpose. 


‘Now a quantum form of the matrix game (6,115) can be played using Marinatto and Weber's 
scheme [52]. The players have at their disposal an initial quantum state: 


Hint) = > eas lid) (6.12) 
igeh? 
with 
X lew = (6.123) 
seta 


In quantum version the male and female players apply the identity J on [yini) with probabilities 
pand q respectively, Also they apply 6x with probabilities (1 ~p) and (1-4), respectively. 
Payoffs to the players are written in a similar form, as in the Bq. (6.119): 


Pu (pq) = PTwa 
Pe(p.g) = "XP. (6.124) 


w and x are quantum forms of the payoff matrices M and F respectively i.e. 


wal) ad gee { ME HE (6.128) 
my wae Xa. Xa 


where 


eu = ans fenl? + a12 fora? + 021 lena? + 072 loxal? 
wa = 043 eral? + ay2 exsl? +001 lone? + ona lenil? 
way = a3 fen |? + aya fonl? + aan foul? + a2e [eral 


aa = 033 leaal? + aya fen? + ans feral? + aa eal? 


similarly 


xan = bia leaf? + bia feral? + bas loasl® + bea lezal? 
x12 = bus Jona? + ban Jal? + bas lezal® + baa Jon” 
xar = bus lean}? + baa fozal? + baa lena? + Ban feral? 
x22 = bus fozal® + bra lol? + bat eval? + bra ena? 


(6.126) 


(6.127) 


For the initial state |i) = 11) the matrices w and x are same as M and F respectively. The 
classical game is, therefore, embedded in the quantum game. Simplified matrices w and x can 


be obtained by the assumption of Eq. (6.118), that is 


on =alen!? +5len!, wa = ale! + bleml? 
wn = alo! + bleu), wa =alen(? + dfer2)? 
yar ele! +dlenl?, x12 = clenl? +dlenal? 
xa =clen!*+dleu!?, x2=clen|*+dleal? 


‘The replicator Eqs. (6.117) can now be written in the following ‘quantum’ form: 


b= 2(1~z)[aKy + by ~ (a+ )(K + Ko)y) 
U=(l —y)leKy + dKe ~ (c+ d)(Ky + Ko)2} 
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(6.128) 


(6.129) 


where Ki = leus|* ~len|* and Ke = lenl? — lea. These equations reduce to Eqs. (6.117) for 
Wins) = [11) ie. leu[? = 1. Similar to the classical version (88) the dynamics (6.129) has five 
rest or equilibrium points ==0,y=0; 2=O,y=1; z=1y=0; 2=1,y=1; 
and an interior equilibrium point: 


cK + dK aK: +5K> 
°° Grate RT "GH RD oe 
This equilibrium point is the same as in the classical game {88] for |Yini) = |11) ie. 
ice 
rp ra (6.131) 


We use the method of linear approximation [89] at equilibrium points to find the general char- 
acter of phase diagram of the system (6.129). Write the system (6.129) as 


#=X(zy), 9=¥(z,y) (6.132) 
‘The matrix for linearization (89) is 
[ Xs | (6.133) 
Ys 3; 


where, for example, X. denotes $F. ‘The matrix (6.133) is evalusted at each equilibrium point 
in turn. Write now these terms as 


Xz = (1 ~ 2x) {aK + Kz — (a +8)(Ky + Ka)y} 

Xy = 21 -2)(a+1)(Ki + Ka) 

Ya = -v(l-y)(e+d)(Ki + Kr) 

Yy = (1 ~2y) (el, + dKa— (c+4)(K; + Ka) z} (6.134) 


and the characteristic equation [89] st an equilibrium point is obtained from 


G-) X% 
Ye (¥%,-4) 

‘The patterns of phase paths around equilibrium points classify the points into a few principal 

cases. Suppose Aj, A are roots of the characteristic Eq. (6.135). A few cases are as follows: 


=0 (6.135) 


1. Ay, Ag are real, different, non-zero, and of same sign. If \,A2 > 0 then the equilibrium 
point is an unstable node or a repelier. If \y, 4g <0 the node is stable or an attractor. 


2. 1, Az are real, different, non-zero, and of opposite sign. The equilibrium point is a saddle 
point. 

3. Ana = kif, and B #0. The equilibrium is a stable spiral (attractor) if a < 0, an 
unstable spiral (repelier) if @ >0, a center if a= 0. 


Consider an equilibrium or rest point x = 1, y = 0, written simply as (1,0). At this point 
tho characteristic Eq. (6.135) has the roots: 


d= 0K -bKa, da = —eg~ aK (6.136) 


For the classical game, ic. [Yini) = |11), these roots are Ay = —a, Ag = —d. Therefore in case 
,d > 0 the equilibrium point (1,0) is an attractor in the classical game. 

Consider the interior equilibrium point (x,y) of Eq. (6.130). ‘The terms of the matrix of 
linearization of Eq. (6.134) are: 


X,=0, Yy= 
x, Raat + aH N0+ 6) 
(+ 4)*(Ki + Ka) 


~(aKy + bKa)(aKe + 6KiN(c+ 4) 
aa ere +) ase) 
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the roots of the characteristic Eq. (6.135) are numbers +A where 


(aK + bK2)(aKa + bKi)(cKs + dKa)(cK2 + dK) 
(a+ B)(c+ d)(Ki + Ka)? 


the term in square root can be a positive or negative real number. Therefore: 


(6.138) 


A saddle (center) in classical game can be a center (saddle) in certain quantum form of 
the game. 


© A saddle or a center in a classical (quantum) game can not be an attractor or a repeller 
in quantum (classical) form of the game. 
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Chapter 7 


Relevance of evolutionary stability 


in quantum games 


Evolutionary game theory considers attractors of a dynamics and ESSs with reference to popu- 
lation models. Extending these ideas to a quantum setting requires an assumption of population 
of individuals, or entities, with access to quantum states and quantum mechanical operators, 
‘What is the possible relevance of such an assumption in the real world? ‘To answer it we observe 
that the concept of evolutionary stability is based on the following assumptions, that also define 
its population setting: 
+ There are random and pair-wise interactions between the participating players forming 
4 population. ‘These interactions can be re-expressed in game-theoretic language by con- 
structing symmetric bi-matrices, 
+ A step-wise selection mechanism that ensures that a successful strategy has better chance 
to spread itself in the population at tho expense of other strategies. 


While bringing the ESS concept to quantum games, we retain the population setting of 
evolutionary game theory as well as the step-wise selection mechanism. However, the games 
played among the players, during pair-wise interactions, are replaced with their quantum coun- 
terparts, Questions now naturally arise how such a switch-over to a quantum game changes 
the evolutionary outcome, 
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Following are the some suggestions where a relevance of quantization of games may affect, 
and even decide, an evolutionary outcome. 


7.1 Quantum mechanics deciding an evolutionary outcome 


Evolutionary game theory was developed to provide game-theoretic models of animal conflicts 
‘that occur in our macro-world. However, recent work in biology [90] suggests that nature 
also plays classical games at micro-level. Bacterial infections by viruses are classical gamo-like 
situations where nature prefers dominant strategies. The game-theoretical explanation of stable 
states in a population of interacting individuals can be considered a model of rationality which 
is physically grounded in natural selection, 

‘A motivation to study evolutionary stability in quantum games exists because the population 
setting of evolutionary game theory can also be introduced to quantum games. It can be done 
on the same ground as itis done in the classical games. The notion of a Nash equilibrium, that 
became the topic of pioneering work on quantum games, was itself motivated by a population 

Consideration of evolutionary stability in quantum games shows how quantization of games, 
Played in « population, can lead to new stable states of the population. It shows that the 
Presence of quantum interactions, in a population undergoing evolution, can alter its stable 
states resulting from the evolutionary dynamics, When quantum effects decide the evolutionary 
outcomes, the role for quantum mechanics clearly increases, from just keeping atoms together, 


to deciding the outcome of an evolutionary dynamics. 


7.2 Development of complexity and self-organization 


This new role for quantum mechanics can be to define and maintain complexity emerging from 
quantum interactions among a collection of molecules. Eigen, Schuster, Sigmund and Wolf 
(86, 87] consider an example of a mixture in which an equilibrium is achieved from compet- 
ing chemical reactions, Such an equilibrium can also be en outcome of quantum interactions 
occurring at molecular level. When quantum nature of molecular interactions can decide an 
equilibrium state, there is a clear possibility for the quantum mechanical role in the models of 
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self-organization in matter, These considerations seem quite relevant to the evolution of macro- 
molecules before the advent of life. ‘The possibility that stability of solutions (or equilibria) can 
be affected by quantum interactions provides # new approach towards understanding of rise of 
complexity in groups of quantum-interacting entities. 

Physicists have expressed opinions (91} about the possibility of quantum mechanics ‘fast 
tracking’ a chemical soup to states that are biological and complex, and the debate continues. 
We suggest that quantum game theory also have contributions to make towards the attempts 
to understand quantum mechanical role in life, especially evolution and development of self 
organization and complexity in molecular systems, and possibly the origin of consciousness, 

Considering development of quantum mechanical models of life, in a recent paper Flitney 
and Abbott [92] studied a version of John Conway's game of Life (93] where the normal binary 
values of the cells are replaced by oscillators which can represent a superposition of states. 
‘They showed that the original game of Life is reproduced in the classical limit, but in general 
additional properties not seen in the original game are present that display some of the effects 
of a quantum mechanical Life. 


7.3 Genetic code evolution 


Genetic code is the'relationship between sequence of bases in DNA and the sequence of amino 
acids in proteins. Suggestions have been made earlier about quantum mechanical role in the 
genetic code. For example, supersymmetry in particle physics, giving # unified description 
of fermions and bosons, have been suggested [94] to provide an explanation of coding assign- 
ments in genetic code. Recent work 95] about evolvability of the genetic code suggests that 
the code, like all other features of organisms, was shaped by natural selection, The question 
about the process and evolutionary mechanism by which the genetic code was optimized is still 
unanswered. Two suggested possibilities are: 


A large number of codes existed out of which the adaptive one was selected. 


‘© Adaptive and error-minimizing constraints gave rise to an adaptive code via code expan- 
sion and simplification. 
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‘The second possibility of code expansion from earlier simpler forms is now thought to be 
supported by much empirical and genetic evidence {96] and results suggest that the present, 
genetic code was strongly influenced by natural selection for error minimization, 

Patel [07] suggested quantum dynamics played a role in the DNA replication and in the 
optimization criteria involved in genetic information processing. He considers the criteria. as 
a task similar to an unsorted assembly operation, with possible connection to the Grover's 
database search algorithm {8}, given different optimal solutions result from the classical and 
quantum dynamics. 

‘The assumption in this approach is that an adaptive code was selected out of a large numbers 
that existed earlier. The suggestion of natural selection being the process, for error minimiza- 
tion in the mechanism of adaptive code evolution, puts forward an evolutionary approach for 
this optimization problem. We believe that, in the evolution and expansion of the code from 
its earlier simpler forms, quantum dynamics has played a role. The mechanism leading to this 
optimization will be, however, different. Our result that stable outcomes, of an evolutionary 
process based on natural selection, may also depend on the quantum nature of interactions 
clearly implies the possibility that such interactions may decide the optimal outcome of evol- 
tion. 

‘We believe that the code optimization is a problem having close similarities to the problem 
of evolutionary stability. And this optimization was probably achieved by interactions that 
‘were quantum mechanical in nature. 


7.4 Quantum evolutionary algorithms 


A polynomial time algorithm that can solve an NP problem is not known yet. A viable al- 
ternative approach, shown to find acceptable solutions within a reasonable time period, is the 
evolutionary search [98]. Iteration of selection based on competition, random variation or mu- 
‘tation, and exploration of the fitness landscape of possible solutions, are the basic ingredients 
of many distinct paradigms of evolutionary computing [99]. On the other hand superposition 
of all possible solution states, unitary operators exploiting interference to enhance the ampli- 
tude of the desired states, and final measurement extracting the solution are the components 
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of quantum computing. These two approaches in computing are believed to represent different 
philosophies [100]. 

Finding ESSs can also be formulated as an evolutionary algorithm. The view that quantum 
mechanics has a role in the theory of ESSs suggests that the two philosophies - considered 
different so far - may have common grounds uniting them. It also hints the possibility of 
evolutionary algorithms that utilize, or even exploit, quantum effects. In such an evolutionary 
algorithm, we may have, for example, fitness functions depending on the amount of entangle- 
ment present. The natural question to ask is then how the population will evolve towards an 
equilibrium state int relation to the amount of entanglement. 


7.5 Evolutionary quantum optimization and computation 


‘The perspective that matrix game theory provides, on what should be an outcome of evolution, 
thas been studied in this thesis. Another perspective is provided by optimization models (101). 
In evolutionary matrix games a frequency-dependent selection takes place and all alternative 
strategies become equally fit when an ESS establishes itself. On the other hand, in optimiza- 
tion models the selection is frequency-independent and evolution is imagined as a hill-climbing 
Process. Optimal solution is obtained when fitness is maximized. Evolutionary optimization is 
the basis of evolutionary and genetic algorithms and is generally considered to be a different 
approach from ESSs in mstrix games. These are not, however, in direct contradiction and 
sive different outlooks on evolutionary process. We suggest that evolutionary optimization is 
another area where a role for quantum mechanics exists and quantum game theory provides 
hhints to find it. 

It seems appropriate to mention here the evolutionary quantum computation (EQC) de- 
scribed in the Ref {102}. In EQC an ensemble of quantum subsystems is considered changing 
continually such a way as to optimize some measure of emergent patterns between the system 
and its environment. It seems reasonable that this optimization is related to an equilibrium 
or some of its properties. When quantum interactions decide the equilibria and their stability 
properties, it implies that the optimization itself depends on it. Brain also has been proposed 
[102] as an evolutionary quantum computer. 


Chapter 8 
Cooperation in quantum games 


8.1 Introduction 


In contrast to non-cooperative games the players in cooperative games are not able to form 
binding agreements even if they may communicate. The distinctive feature of cooperative 
games is a strong incentive to work together to receive the largest total payoff. Thesé games 
allow players to form coalitions, binding agreements, pay compensations, make side payments 
etc. Von Neumann and Morgenstern (2] in their pioneering work on the theory of games offered 
models of coalition formation where the strategy of each player consists of choosing the coalition 
s/he wishes to join. In coalition games, that are part of cooperative game theory, the possibilities 
for the players are described by the available resources of different groups (coalitions) of players. 
Joining a group or remaining outside is part of strategy of a player affecting his/her payoff. 

Recent work in quantum games arises a natural and interesting question: what is the 
Possible quantum mechanical role in cooperative games that are considered an integral part 
of the classical game theory? In our view it may be quite interesting, and fruitful as well, 
to investigate coalitions in quantum versions of cooperative games. Our present motivation 
is to investigate what might happen to the advantage of forming a coalition in a quantum 
‘game compared to its classical anslogue. We rely ou the concepts and ideas of von Neumann's 
cooperative game theory [2] and consider a three-player coalition game in a quantum form. We 
then compare it to the classical version of the game end see how the advantage of forming a 
coalition can be affected. 


Tn classical analysis of coalition games the notion of a strategy disappears; the main features 
are those of a coalition and the value or worth of the coalition. ‘The underlying assumption is 
that each coalition can guarantee its members a certain amount called the ‘value of a coalition’, 
“The value of coalition measures the worth the coalition possesses and is characterized as the 
payoff which the coalition can assure for itself by selecting an appropriate strategy, whereas 
the ‘odd man’ can prevent the coalition from getting more than this amount” [104]. Using this 
definition we study cooperative games in quantum settings to see how advantages of making 
coalitions can be influenced in the new setting. 

Within the framework of playing « quantum game given by Marinatto and Weber, we find 
‘4 quantum form of a symmetric cooperative game played by three players. In classical form 
of this game any two players, out of three, get an advantage when they successfully form a 
coalition and play the same strategy. We investigate how the advantage for forming a coalition 
are affected when the game switches its form from classical to quantum. 


8.2 A three-player symmetric cooperative game 
8.2.1 Classical form 


‘A classical three-person normal form game {104] is given by: 


© Three non-empty sets £4, Dp, and De. These are the strategy sets of the players A, B, 
and C. 


* Three real valued functions Pa, Pg, and Pe defined on £4 x Ep x Ee. 


‘The product space £4 x Eg x Lc is the set of all tuples (04,08,0¢) with on € £4, 08 € Da 
and g¢ € Ei. A strategy is understood as such a tuple (¢4,08,0c) and Pa, Pa, Po are payoft 
functions of the three players. The game is denoted as T = {£4,5p,Dc;Pa,Pa,Po}. Let 
R= {A,B,C} be the set of players and p be an arbitrary subset of ®. The players in p may 
form a coalition so that, for all practical purposes, the coalition p appears as a singleplayer. 
It is expected that players in (8 —p) will form an opposing coalition and the game has two 
‘opposing “coalition players” i.e. p and (8 — p). 
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We study quantum version of an example of a classical three player cooperative game dis- 
cussed in Ref. [104]. Each of the three players A, B, and C' chooses one of the two strategies 1, 
2. If the three players choose the same strategy there is no payoff; otherwise, the two players 
who have chosen the same strategy receive one unit of money each from the ‘odd man.’ Payoff 
functions P,, Py and Pe for players A, B and C, respectively, are given as [104]: 


P4(1,1,1) = Pa(2,2,2) =0 
Pa(1,1,2) = Pa(2,2,1) = Pa(2,2,1) = Pa(2,1,2) =1 
Pa(],2,2) = Pa(2,1,1) = -2 (81) 


with similar expressions for Pg and Po. Suppose p ='{B,C}, hence R—p = {A}. ‘The coalition 
game represented by D, is given by the payoff matrix (104): 


Pl 
ty fo 2 
pq] -1 -1 
fy | -1 -1 ae 
py \2 0 


Here the strategies [12] and [21] are dominated by 11] and [22]. After eliminating these domi- 
nated strategies the payoff matrix becomes 


f 2 
ire) ( 0 “| iid) 
20 
It is seen that the mixed strategies: 
1 1 
gll+5 4, (8.4) 


1 1 
zll+5el- (8.5) 
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are optimal for p and (8 — p) respectively, With these strategies a payoff 1 for players p 
is assured for all strategies of the opponent; hence, the value of the coalition v(T,) is 1 ie. 
v({B,C}) = 1. Since P is a zero-sum game v(U'p) can also be used to find u(T'e-p) as u({A}) = 
~1. The game is symmetric and one can write 


v(fp)=1, and v(lp-p) =—lor 
u({A}) = u((B}) = v({C}) = -1 
u({A,B}) = v({B,C}) = w({G,A}) = 1 (8.6) 


8.2.2 Quantum form 


In quantum form of this three-player game the players ~ identified as A, B and C ~ play their 
strategies by applying the identity operator / with probabilities p, , and r, respectively, on a 
three-qubit initial quantum state. The players apply the operator &, with probabilities (1—p), 
(1 4), and (1 ~ +) respectively. If pin is the initial state, the final state, after players have 
played their strategies, becomes 


prin= Y, Pr(On)Px(On)Pr(Uc)0n @ On © Ucpinlh @ 0} @ 0}, (a7) 
O=lan 


where the unitary and Hermitian operator can be either / or 6». Pr(J4), Pr(Og) and Pr(Ue) 
‘are the probabilities with which players A, B, and C apply the operator J on the initial state 
respectively. pyin corresponds to a convex combination of players’ quantum operations, Let the 
arbiter prepares a three-qubit pure initial quantuin state: 


Hin) = eagnligh), whore > leigf? =1 (88) 
rey sich 


where the basis vectors of the quantum state are jijk) for i,j,k = 1,2. ‘The state (8.8) is in 
2@2@2 dimensional Hilbert space and corresponds to three qubits. 

Assume the matrix of the three-player game is given by 24 constants az, At, % with <t <8. 
Write the payoff operators for players A, B and C as 


ut 


(Pa,B,0)oper = 45 tym (111) (111 ++ ory Bay 2 (212) (211) + 
(43, gy P3 [L2) (121] ++ cra, Bay |122) (112| + 
85, B45 1122) (122 + cg, sy ¥6 [212) (212| ++ 
(m7, ir, |221) (221 + cy, Bs [222) (222 (8.9) 


Payoffs to the players A, B and C are then obtained as mean values of these operators: 


apolar) = Tr ((PA,B,c)operPyin] (8.10) 


‘Where the players’ moves are identified by the numbers p, q and r, respectively. Fig. (8-1) 
shows the three-player quantum game. The cooperative game of Eq. (8.1) with the classical 
payoff functions P4, Ps and Pe for players A, B and C respectively, together with the definition 
of payoff operators for these players in Eq. (8.9), imply that 


@ =a3=0, o3=a4=ag=07=1, and a2=05= (8.11) 


With these constants, in quantum version of the game, the payoff to player A, for example, can 
be found as 


(-4rq — 2p + 2pr + 2pq +r + q){lenal? + Jezzal”) 
+(-drq + 2p ~ 2pr — 2p +3 +39 — 2)(lenal? + forza”) 
+(4rq + 2pr — 2pq ~ 37 - q+ 1)(ler2 + lenal”) 
+(4rq — 2pr-+2pq — 1 ~ 39+ 1)( lena + leanl’) 
‘Similarly, payofis to players B and C can be obtained. Classical mixed strategy payoffs can be 
recovered from the Eq. (8.12) by taking |cr:{* = 1. The classical game is therefore imbedded 

in its quantum form. 
‘The classical form of this game is symmetric in the sense that payoff to a player depends on 
his/her strategy and not on his/her identity. These requirements that result in a three-player 


Palp.ayt) = (8.12) 


symmetric game are written as 
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Figure 8-1: A three-player quantum game played with Marinatto and Weber's scheme. Players 


B and C form a coalition. / is the identity and &. is the inversion operator. 
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Palrrar) = Pa(psrsa) = Pa(apyr) = Palrsp.a) 
= Polr,ayp) = Palasrsp) (8.13) 


‘Now in this quantum form of the game, Pa(p,4,r) becomes same as Pa(p,7,q) when [105]: 


leuar!? + Loaral® = lo1sal? + lozanl? (8.14) 


Similarly Pa(q,p,r) = Pa(r,p,9) and Po(r,q,p) = Po(q,7p) when the following conditions 
hold 105}: 


leat? + fexzal® = lensal? + Jeaal? 
Jonna}? + feral? = lena? + lenal? (8.15) 


Combining Eq. (8.14) and Eq, (8.15) give 


leaul? + Jenzal® = Jovan? + Jeaal? = Jenal? + lem? (8.18) 


and then payoff to a p-player remains same when other two players interchange their strategies. 
‘The symmetry conditions (8.13) hold if, togethor with Eqs. (8.14), the following relations are 
also true 


m=A=n, a= ho= 17 
m= f=, 06 = Ps = 16 
a= hh=T a= 
y= fy =n, 08 = a= 


(8.17) 


‘These form the extra restrictions on the constants of payoff matrix and, together with the 
conditions (8.14), give a three player symmetric game in a quantum form. No subscript in a 
payoff expression is then needed and P(p,q,r) represents the payoff to a p-player against. two 
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other players playing q and r. The payoff P(p,q,r) is found as 


P(p.asr) = (leant? + leazal? — Joaal?  lerzal?)(—4rg -2p+2pr + 2pq+r+q) (8.18) 


Assume now that the pure strategies {1] and 2] correspond to p = 0 and p = 1, respectively. 
The mixed strategy n[1] + (1 -n)|2], whore 0 <n < 1, means that the strategy [1] is played 
with probability n and {2] with probability (1 n). Also suppose that coalition p plays the 
mixed strategy': 


tpi] + 0-22) (8.19) 


where the strategy [11] means that both players in the coalition apply the identity operator 
J with zero probability, Similarly the strategy (22] can be defined. ‘The strategy in the Eq. 
(8.19) is euch that the coalition p plays [11] with probability ! and (22] with probability (11). 
Similarly assume that the player in (8 — p) plays the mixed strategy: 


mfl] + (1 ~m)(2] (8.20) 


‘The payoff to the coalition p is then obtained as 


Po = (Im) Pony +1 m) Porat 
(1=DmPeyay + (1) —m) Pepaaay (8.21) 


where P,j1i) is the payoff to p when all three players play p = 0 i.e, the strategy (1, Similarly 
Peay is the coalition payoff when the coalition players play p= 1 and the player in (8 - p) 
plays p=0. Now from Eq. (8.18) we get 

‘In a Comment on “Quantum cooperative games” that appeared in Physics Letters A, Volume 328, Issues 
45, Pane eelis a Agger MOL dlses Del tat Ghee cone i pebvol oe ad eared ine el ape 


[12] and [21] are not always dominated by {11} and {22] in quantum form, there is no ground for assuming that 
the coalition p always plays the mixed strategy {(01} + (1 ~ 1[22) 
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Pyun] = 2P(0,0,0) =0 
Potura) = 2P(0,0, 1) = 2(lernal? + lezzal® — leanal? — fexzal*) 
Pefons) = 2P(1, 1,0) = 2(lorsal? + fozzal® — loans? — lexzal?) 


Pofana) = 2P(1)1, 1) =0 (8.22) 
‘Also from Eq. (8.21): 
Py = A(lenl? + lexzal? — lonl? ~ lerzal®){0(1 ~m) + (1 —2)m} (8.23) 


‘To find the value of coalition v(T,) in the quantum game we find 9 and equate it to zero 
J.e. Pp is such a payoff to pp that the player in (8 — p) cannot change it by changing his/her 
strategy given in Eq, (8.20). It gives, interestingly, ! = } and the classical optimal strategy of 
the coalition } (11] 44 [22] becomes optimal in the quantum game as well. In the quantum game 
the coalition then secures following payoff, which is also termed as the value of the coalition: 


UC p) = (lesan? + Jexzal®) — (leanal? + lexzal?) (8.24) 


Similarly we get the value of coalition for (R - p): 


~ {les!® + eal? + enna? + feel? } (825) 


Note that these values reduce to their classical counterparts of Eq. (8:6) when the initial 
quantum state becomes unentangled and is given by yin) = |111). Classical form of the 
coalition game is, therefore, a subset of its quantum version. 

Suppose the arbiter now has at his disposal a quantum state: 


in) = c1an |111) + cpan|222) + ca11 |211) + e129 |122) 
with (lena? + lerzal?) > (lenal? + lexzal?) (8.26) 
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If we assume that, with this initial state, the coalition p still plays the mixed strategy? I(11] + 
(1 ~1)[22] of the classical case, then u(F'p) becomes a negative quantity and v(T gp) = —1 
because of the normalization given in Eq. (8.8). Another possible case is when the arbiter has 
the state: 


in) = enna 1211) + exz0 [122) (827) 


at his disposal. Because now both v(I',) and v(I'y-,) are —1 and the players are left with no 
motivation to form the same coalition as they do in the classical game. 

Liang Dai and Qing Chen [105] have observed ® that in case Je111[*+lozza!” # Jonnil*+lerzal?, 
the motivation to form a coalition remains in the quantum form. In ease Je1s1|° + lezal? = 
leauf? + leazal?, every player's payoff becomes zero whatever strategies they adapt, and hence 
the motivation to form a coalition is lost. 


“Liang Dai and Qing Chan have also indicated that, when (len: {? + lerz|*) > (Jenn? + [eaal”) the strategies 
40+ Hl and JU) + 4 a opal 

*Liang Dai and Qing Chen (105} pointed out a law in the calculations in the Ref, (103) by Iqbal and Toor. We 
‘argue that even after the detection of the indicated flaw by Liang Dai and Qing Chen [105 the main conclusion 
‘of the Ref. [103] remains intact. It can be seen as follows. 


lost.” 


‘In view of this quote along with Liang Dai and Qing Chen's finding that when Je] + lom|? = feau|? + 
{erzal* their remains no motivation to form a coalition, it can be observed that, even after the indicated 
flaw in the calculation, the main conclusion of the Ref. (103] remain intact. It is because the assumption 
‘ade, in the Ref, 103}, which is quoted above in detail, allows to consider the corresponding game when 
leas}? + leamal? = onal? + lexal® a8 « quantim form of the classical game. So that, Liang Dai and Qing 
Chen [105] main conclusion is same as in the Ref. [103], apart from their identification of the correct 
mathematical conditions that are required to find the particular quantum form of the game in which the 
advantages of forming a coalition are lst. 
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8.3 Discussion 


‘There may appear several guises in which the players can cooperate in a game. One possibility 
is that they are able to communicate and, hence, able to correlste their strategies. In certain 
situations players can make binding commitments before or during the play of a game. Even 
in the post-play behavior the commitments can make players to redistribute their final payoffs. 

‘Two-player games are different from multi-player games in an important aspect. In two- 
player games the question before the players is whether to cooperate or not. In multi-player 
case the players are faced with a more difficult task. Each player has to decide which coalition 
to join. There is also certain uncertainty that the player faces about the extent to which players 
outside his coalition may coordinate their actions. 

Recent developments in quantum games provide a motivation to see how forming a coali- 
tion, and its associated advantages, can be influenced in quantum versions of these classical 
cooperative games. To study this we selected an interesting, but simple, cooperative game and 
8 recently proposed scheme telling how to play a quantum game. We allowed the players in the 
quantum version of the game to form a coalition similar to the classical game. 

The underlying assumption in this approach is that because the arbiter, responsible for 
providing three-qubit pure initial quantum states, to be later manipulated by the players, can 
forward a quantum state that corresponds to the classical game, therefore, other games that 
result from different initial pure quantum states are quantum forms of the classical game. This 
assumption reduces the problem of finding a quantum version of the classical coalition game to 
finding some pure initial quantum states. It is shown that a quantum version of the three-player 
coalition game can be found where the motivation for coalition formation is lost. 
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Chapter 9 


Backwards-induction outcome in 


quantum games 


9.1 Introduction 


‘The notion of NE, the central solution-concept in non-cooperative game theory, was developed 
by John Nash in early 1950s. In fact Cournot (1838) {25] anticipated Nash's definition of 
equilibrium by over a century but only in the context of a particular model of a market which 
is dominated by only two producers. In economics an oligopoly is a form of market in which a 
number n of producers, say, n > 2, and no others, provide the market with a certain commodity. 
In the special case where n =2 it is called a duopoly. Cournot's work [25] is one of the classics 
of game theory and also a cornerstone of the theory of industrial organization [106]. 

In Cournot model of duopoly two-firms simultaneously put certain quantities of a homoge- 
neous product in the market. Cournot obtained an equilibrium value for the quantities both 
firms will decide to put in the market, This equilibrium value was based on a rule of behavior 
which says that if all the players except one abide by it, the remsining player cannot do better 
than to abide by it too. Nash gave a general concept of an equilibrium point in a noncooperative 
game but existence of an equilibrium in duopoly game was known much earlier. The “Cournot 
equilibrium” refers to NE in non-cooperative form of duopoly that Cournot considered. 

In an interesting later development, Stackelberg (1934) (107, 108] proposed a dynamic model 
of duopoly in which - contrary to Cournot’s assumption of simultaneous moves ~ a leader (or 
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dominant) firm moves first and a follower (or subordinate) firm moves second. A well known 
‘example is the General Motors playing this leadership role in the early history of US automobile 
industry when more than one firms like Ford and Chrysler acted as followers. In this sequential 
game a “Stackelberg equilibrium” is obtained using the backwands-induction outcome of the 
game. Stackelberg equilibrium refers to sequential nature of the game and it is a stronger 
solution-concept than the NE because sequential move games sometimes have multiple NE , 
only one of which is associated with the backwards-induction outcome of the game [108]. 

In this chapter we present a quantum perspective on the interesting game of Stackelberg 
duopoly. We start with the same assumption that a game is decided only by players’ unitary 
‘manipulations, payoff operators, and the measnring apparatus deciding payoffs. When these 
are same a different input quantum initial state gives a different form of the same game. With 
this assumption we studied evolutionary stability of a mixed NE in the RSP game. Hence, a 
game obtained by using a general two-qubit pure state is a quantum form of the classical game 
Provided the rest of the procedures in playing the quantum game remain same. 

‘We now present an analysis of the Stackelberg duopoly by raising a question: Is it possible 
to find a two-qubit pure quantum state that generates the classical Cournot equilibrium as 
's backwards-induction outcome of the quantum form of Stackelberg duopaly? Why can this 
question be of interest? It is interesting because in case the answer is yes, then, quantization can 
potentially be a useful element for the follower in the leader-follower model of the Stackelberg 
duopoly [108]. It is due to a known result that, in classical setting, when static duopoly changes 
to a dynamic form, the follower becomes worse-off compared to the leader who becomes better- 
off. We find that, under certain restrictions, itis possible to find the needed two-qubit quantum 
states. Hence a quantum form of a dynamic game of complete information has an equilibrium 
that corresponds to classical static form of the same game, The leader, thus, does not become 
better-off in the quantum form of the dynamic duopoly. 


9.2 Backwards-induction outcome 
Consider a simple three step game: 
1. Player 1 chooses an action a; from the feasible set A. 
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2, Player 2 observes a, and then chooses an action a2 from the feasible set Az. 
3. Payoffs are uj(a1, a2) and ua(a;, a2). 


‘This game is an example of the dynamic games of complete and perfect information. Key 
features of such games are: 


1, ‘The moves occur in sequence. 
2, All previous moves are known before next move is chosen, and 
3. The players’ payoffs are common knowledge. 


Given the action a; is previously chosen, at the second stage of the game, when player 2 
gets the move s/he faces the problem: 


Maz wa(ai,02) @1) 


Assume that for each a; in Ay, player 2's optimization problem has a unique solution Ra(a1), 
which is also known as the best response of player 2. Now player 1 can also solve player 2's 
optimization problem by anticipating player 2's response to each action a; that player 1 might 
take. So that player 1 faces the problem: 


Maz wi (a1, Ra(a1)) (9.2) 


‘Suppose this optimization problem also has a unique solution for player 1 and is denoted by 
a}. The solution (aj, R2(aj)) is the backwards-induction outcome of this game. 

In a simple version of the Cournot’s model two firms simultaneously decide the quantities 
491 and g respectively of a homogeneous product they want to put into market. Suppose Q is 
the aggregate quantity ie. Q = q+ and P(Q)=a~Q be the market-clearing price, which 
is the price at which all products or services available in a market will find buyers. Assume the 
total cost to a firm producing quantity 9; is cq; i.e. there are no fized costs and the marginal 
cost is a constant ¢ with ¢ <a, Ina two-player game theoretical model of this situation a firm’s 
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payoff or profit can be written as {108} 


Palins) = 9 [P(Q)— 4 = Glo - c- (a +g) = a: fk - i +95) (93) 


Solving for the NE easily gives the Cournot equilibrium: 


a=a=% (94) 


At this equilibrium the payoffs to both the firms from Eq. (9.3) are 


P 

Pi(Gis G3) cournce = Pa(Qis93)cournat => (95) 
Consider now the classical form of duopoly game when it becomes dynamic. In dynamic form of 
the game the payoffs to players are given by Eq. (9.3) as they are for the Cournot’s game. We 
find backwards-induction outcome in classical and a quantum form of the Stackelberg's duopoly. 
‘Taking advantage from a bigger picture given to this dynamic game, by the Hilbert structure 
of its strategy space, we then find two-qubit pure quantum states that give classical Cournot's 
equilibrium as the backwards-induction outcome of the quantum game of Stackelberg’s duopoly. 
9.3 Stackelberg duopoly 


9.3.1 Classical form 


A leader (or dominant) firm moves first and a follower (or subordinate) firm moves second in 
Stackelberg model of duopoly [108]. The sequence of events is 


1. Firm A chooses a quantity q > 0. 
2. Firm B observes q: and then chooses a quantity ¢ > 0. 


3. The payoiis to firms A and B are given by their respective profit functions as 
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Palau) = a1 [k ~ (1 +02)] 
Pala. 42) = ok - (1 + 2)) (9.6) 


‘The backwards-induetion outcome is found by first finding firm B's reaction to an arbitrary 
quantity by firm A. Denoting this quantity as Ra(q,) we find 


Palen) = Maz Patan en) = 45% oo) 


with q < k. Firm A can now solve also the firm B's problem. Firm A can anticipate that a 
choice of the quantity ¢; will meet a reaction Ra(q;). In the first stage of the game firm A can 
then compute a solution to his/her optimization problem as 


Maz Pala Ra(a)| = Mag SAO) (08) 
Tt gives 
a= 5 and Relat) = ; (99) 


Tt is the classical backwards-induction outcome of dynamic form of the duopoly game. At this 
equilibrium payofis to the players A and B aro given by Eqs. (9.6) and (9.9) 


alti Paoaiey= Es Fatt PoCMaasinny= "(010 
From Eq. (9.10) find the ratio: 


(9.1) 
showing that in comparison with the Cournot game, the leader firm becomes better-off and the 
follower firm becomes worse-off in the Stackelberg game. This aspect also hints an important 
difference between single and multi-person decision problems. In single-person decision theory 
hhaving more information can never make the decision maker worse-off. In game theory, how- 
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ever, having more information (or, more precisely, having it made public that one has more 
information) can make a player worse-off (108). 

Now we look at the backwards-induction outcome in a quantum perspective. Our motivation 
is an interesting aspect that quantum form can bring into the backwards-induction outcome. 
It is the possibility of firm B not becoming worse-off because of having extra information. 


9.3.2 Quantum form 


Stackelberg duopoly is a two-player sequential game. Meyer (19] considered a quantum form 
of the sequential game of PQ penny flip by unitary operations on single qubit. Important 
difference between Meyer's game and Stackelberg duopoly is that at the second stage player in 
PQ penny ftip doesn’t know the previous move but in Stackelberg duopoly he knows that. 

‘We prefer Marinatto and Weber's scheme to play the sequential game of Stackelberg duopoly 
for two reasons: 


1, The classical game is obtained for a product initial state. 


2. When players’ actions and payoff-generating measurement. are ezactly the same, we as- 


sume other games, corresponding to every pure two-qubit initial state, are quantum forms 
of the classical game. 


AAs discussed earlier, the second assumption originates from the fact that the classical game 
corresponds to a pure two-qubit initial product state. The assumption reduces the problem 
of finding a quantum form of Stackelberg duopoly, with the property that its equilibrium is 
the same as in Cournot’s duopoly, to the problem of finding conditions on the parameters of 
two-qubit pure initial quantum state. If the conditions are realistic then the corresponding 
quantum game gives Cournot's equilibrium as the backwards-induction outcome. 

Stackelberg duopoly is a dynamic game of complete information, Its quantum form in 
Marinatto and Weber's scheme starts by proparing pure two-qubit initial quantum state, 
‘Suppose Alice plays first and she announces her move immediately, so that Bob knows Alice’s 
move before playing his move. Bob plays his move and both players forward their qubits for 


measurement. 
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Information about the previous moves is crucial for the game considered here. A compar- 
ison of the sequential game of Stackelberg duopoly with the simultaneous-move game of BoS 
makes evident different information structure in these games, For example let BoS be played 
sequentially. But Alice does not announce her first move to Bob before he makes his. It makes 
‘the game sequential but the information structure is still the same as in its static form. Hence, 
‘sequential BoS in the above form has the same NE. as in its static form. An unobserved-action 
form of a game has the same NE as its simultaneous-move form. This observation led us'to play 
4 quantum form of Stackelberg duopoly while keeping intact the original structure of a scheme 
designed for simultaneous moves. A consideration of playing a sequential game in a quantum 
way brings to mind the Meyer's PQ penny-ftip [19] where only one qubit is used. Contrary to 
this, in present section we use the two-qubit system of a simultaneous-move game, to play a 
sequential game, 

Why to use two qubits when a quantum form of this sequential game can also be played 
by only one qubit, in similar way as Meyer's PQ penny-flip. We prefer two qubits because in 
this case a comparison between classical and a quantum form of the game translates itself to 
comparing two games resulting from using a product and an entangled initial quantum state, 
We do not rule out the possibility that « consideration of the dynamic game using only single 
qubit gives equally, or even more, interesting results, We let classical payoffs in Stackelberg 
duopoly, given by Eq. (9.6), reproduced when the initial state |yyn) = |11) is used to play the 
game. ‘The upper state of a qubit is then represented by 2. The state [yin) in density matrix 
notation is 


Pin = [11) (1) (9.12) 


Assume the player ‘Alice and Bob apply / with probabilities « and y respectively. ‘The state 
(9.12) changes to 


Prin = 2l4 @ Inpialy @ th +-2(1 ~y)la @Geapnlh @atyt 
WA ~ 2). @ Ippind!, @ I}, +(1~2)(1~y)oea@ Fenpindl, @ 2! 
(9.13) 


where 2,4 € [0,1] are identified as the players’ moves. ‘The moves by Alice and Bob in classical 
duopoly game are given by quantities gy and gy where 192 € (0,00). We assume that Alice 
and Bob agree on a function that can uniguely define a real Positive number in the range (0, 1] 
for every quantity g,, 99 in (0,00). A simple such function is 1/(1+4). So that, Alice and Bob 
find and y, respectively, as 


the final state (9.13) becomes 


1 
Phin = Wradre (112) (2 + a4 122) (22) + 9, J21) (21 + @2 12) (12I] (9.15) 


Wenow assume that in the measurement and payofiefinding phase the ‘quantities q and go 
are also known to the referee, ‘The referee applies the following, payoff operators on the final 
quantum state: 


(Pa)oner = (1+ 91)(1 + da)au (ke 12) (11) = (21) (21) ~ |12) (12)) 
(Pa)oper = (A+ 91)(1+ go)on 11) (11] ~ (21) (23] ~ |12) (12)) (9.16) 


Note that the classical payoffs of Eq. (9.6) are reproduced with the initial state [yin) = |11) as 


PA,p(qs%) = Tr[(P4,2)operP fin] (9.17) 


A more general form of quantum duopoly can now be played by keeping the payoff operators 
of Eq. (9.16) in the referee's possession and prepsring an initial two-qubit pure state: 


Wi) = Soy fif), with So ogi? =1 (9.18) 
ijai2 ign 


Payolfs to Alice and Bob can now be obtained, in this quantum game, from Eqs. (9.17) that 
use the payoff operators of Eqs. (9.16). The payoffs to Alice and Bob are written as 


[Paltns@gom = (wu + wag) + a1(war + wre) 


(+a) +) 
= ir + xm) + (xa +xmm) 
[Ps (1,42) gm = ey esr ed (9.19) 
where the subscript gtm is for ‘quantum’ and 
on fen! fe? len!® lea? ] [ sn(t+a)a+e) 
wa |_| lea? lenP lea? fen! | | -n+e0+e) 
on} | lea? len! len! leaf? | | -n+ayr+e) 
wn fezal? Jenn? lezl? Jensl? 0 
xn leu lea? Jen! fowl? | [ boa(1-+0)0+0) 
xin |_| lel? len? fel? fenl? | | -e0+0)0 +0) 
xa lea Jee? leu! Jeol? | | -eot +a) +0) 
xn lez? fen? feral? lenf? o 
(9.20) 


The classical payoffs of duopoly game given in Eqs. (9.6) are recovered from the Eqs. (9.19) 
when the initial quantum state is ini) = |11). Classical duopoly is, therefore, a subset of its 
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‘Alice's payott 


Init quanta 


sete ns) 


Figure 9-1: Playing a quantum form of Stackelberg duopoly. 


quantum version. 

We now find the backwards induction outcome in this quantum form of Stackelberg duopoly. 
Fig, (0-1) shows the overall idea to play the game. We proceed in exactly the same way a5 
it is done in the classical game except that players’ payolls are now given by Eqs. (9.19) and 
not by Eqs. (9.6). The first step in the backwards-induction in quantum game is to find Bob's 
reaction to an arbitrary quantity q: chosen by Alice. Denoting this quantity as [Pa(%)lgtm We 
find 


mdi +42 


[Ra(a)lgem = Moz [Pa(a1.42)lqem = emt ad (9.21) 
where 
jenl? + lon —Bleal?=21, Jena +lenl? —#lenl* = A 
Jeval? + lent? — lead? = As, en? +lezal? ~Klenal? = Ae (0.22) 
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‘This reaction reduces to its classical value of Eq. (9.7) when |er1|? = 1. Similar to the classical 
‘game Alice can now solve Bob's problem as woll. Alice can anticipate that a choice of quantity 
4 will meet a reaction [Ra(41)]qem- In the first stage of the game, like its classical version, Alice 
can compute a solution to her optimization problem as 


Mog [Pa {a1.(Ra(0)hoon}] (923) 
To find it Alice calculates the quantity: 


aleve = eal lel? — lel? — len) (a 4 (2) +4} 


Q+a) 
+ (042m) {( 1) font? — feral?) + (lena? — fel?) 
=n (e+ mda) ~ a Onds+ Ae) 
(9.24) 


and replaces gz in Eq, (9.24) with [R2(1)]qim given by Eq. (9.21) and then equates Eq. (9.24) 
to zero to find a gf that maximizes her payoff [P4(¢i,2)lqqm- FoF 8 maxima she would ensure 
that the second derivative of Pa {91s {Re(¢)}yom} with respect to qr st q1 = gf is a negative 
quantity. The quantity gj together with [a(¢})|qim Will form the backwards-induction outcome 
of the quantum game. 

‘An intoresting situation is when the backwards-induction outcome in quantum version of 
Stackelberg duopoly becomes same as the classical Cournot equilibrium of duopoly. ‘The class- 
cal situation of leader becoming better-off, while the follower becomes worse-off, is then avoided 
in the quantum form of Stackelberg duopoly. To look for this possibility we need such an initial 
state [Vini) that at gf = 93 = k/3 we have the following relations to be true, along with the 
normalization condition given in Eq. (9.18): 
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4 [Pa {a1-€Ra(t) gem} on ‘ 
St 


aa (9.28) 

@ |Pain, {Rala)}, 
“TPefontnieon en lana | <0 (9.26) 
G = {RalQi) etm (9.27) 


‘The conditions (9.25, 9.26) simply say that the backwards-induction outcome of the quantum 
game is the same as Cournot equilibrium in classical game. The condition (9.27) says that 
Bob's reaction to Alice's choice of gj = k/3 is qj = k/3. ‘To show that such quantum states can 
‘exist for which the conditions (9.25, 9.26, 9.27), with the normalization (9.18), to be true, we 
give an example where |c1:/* , era)” and |eai|* are written as functions of k, with our assumption 
that lenal* = 0. Though this assumption puts its own restriction, on the possible range of k for 
which the above conditions hold for these functions, but still it shows clearly the possibility of 
finding the required initial quantum states. The functions are found as 


+ VIEF= BOD here 


258) 
1) = 50 {Je tes dh {F+E+3} 


len()P = 


Bg 


sar {Bees he 2} 4am (Bees Sede }+ 


afk) = ; 


(0.28) 
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Jeni (F)/? = 5€4) lena()? (9.29) 
ern(2))? = 1 — lera())? — loan ()? (9.30) 


Now, interestingly, given that allowed range of k is 1.5 < k < 1.73205, all of the conditions 
(9.18, 925, 9.26, 9.27) hold at of = 93 = k/3. So that in this range of k © quantum form 
of Stackelberg duopoly exists that gives the classical Cournot equilibrium as the backwards- 
induction outcome, The restriction on allowed range of k is the result of our assumption that 
lena(k)|? = 0, which is introduced to simplify the calculations. Nevertheless it does not forbid 
obtaining a quantum form of Stackelberg duopoly, without the mentioned restriction of the 
range of k, when the quantum game still possesses the same properties. 


9.4 Discussion 


‘What can be a possible relevance of considering a quantum form of a game that models a 
competition between two firms in macroscopic world of economics? Quantum mechanics was 
developed to understand phenomena in the regime of atomic and subatomic interactions and it 
is still mostly used in that domain. What is of interest in extending a game-theoretical model of 
interaction between firms towards quantum domain? These questions naturally arise not only 
with reference to Stackelberg duopoly considored in this paper but also other related works in 
quantum games. 

‘We believe that like other notions of game theory, finding some relevance in quantum infor- 
mation, a consideration of backwards induction can be of interest for exactly the same reasons. 
It does not seem hard to imagine situations in quantum information where moves occur in 
sequence, all previous moves are observed before the next move is chosen, and players’ payoffs 
from each feasible combination of moves are common knowledge. Interesting questions then 
arise about how a quantum version of dynamic game of complete information can influence the 
outcome. 

‘The duopoly game models economic competition between firms and applied economics is 
the area where it is studied in detail. The fact that quantum game theory can give entirely 
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new views on games, which are important in economics, is apparent in recent interesting papers 
by Piotrowski and Sladkowski (56, 57] proposing a quantum-like description of markets and 
economies where players’ strategies belong to Hilbert space. It shows that quantum games 
certainly have features of interest to applied economists. Reciprocating with it we showed that 
‘games played by firms in economic competition can give counter-intuitive solutions when played 
in the quantum world. 
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Chapter 10 
Quantum repeated games 


10.1 Introduction 


‘The PD attracted early attention (20) in recent studies in quantum game theory. In classical 
game theory [108] a two-stage repeated version of this game consists of two players playing the 
game twice, observing the outcome of the first play before the second play begins. ‘The payofts 
for the entire game are simply taken as the sum of the payofis from the two stages. Generally a 
two-stage repeated game has more complex strategic structure than its one-stage counterpart 
and players’ strategic choices in the second stage are affected by the outcome of their moves in 
the first stage. For the classical one-stage PD the strategy of ‘defection’ by both the players is a 
‘unique NE, In its two-stage version the same NE appears again at the second stage because the 
first stage payoffs are added as constants to the second stage. In fact in all of finitely repeated 
versions of the PD ‘defection’ by both the players appears as unique NE at every stage [108]. 
isert et al.'s study (20] of the one-stage quantum PD raises a question: what can possibly 
be a role for quantum mechanics when the game is played twice? It seems that this role 
should be relevant to the new feature showing itself in the game i.e, the two-stages. A role for 
quantum mechanics exists if it inter-links tho two stages of the game in some way of interest. 
Classically both the players ‘defect? at each stage and strategic choices remain the same because 
of uniqueness of the NE at each stage. In our search for a quantum role we find useful the idea of 
subgame-perfect outcome (SGPO) [108] in @ two-stage repeated bi-matrix game in its quantum. 


form. 
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For a two-stage repeated game the idea of a SGPO is natural analog of the backwards- 
induction outcome (BIO) [108] from the games of complete and perfect information. In the 
last chapter we considered the BIO idea in a quantum form of duopoly game and showed how 
a quaritum version of this game can give an outcome corresponding to the static form of the 
duopoly, even when the game is played dynamically. In present chapter we study the natural 
analogue of BIO for a two-stage repeated PD quantum game, i.e., the idea of SGPO in a 
situation that can be said to lie in quantum domain. We solve the two-stage PD quantum 
game in the spirit of backwards-induction from the last section; but now the first step in 
working backwards from the end of the game involves solving a real game rather than solving 
‘a single-person optimization problem. 

In game theory the idea of SGPO comes out as a stronger solution concept especially when 
multiple NE appear in a stage. Our motivation is the observation that a quantization scheme for 
the PD is known in which the NE in astage is not unique ~ thus making relevant a consideration 
of the concept of SGPO in the two-stage game played in a quantum setting, For the purpose of 
completeness, we will first describe how SGPO works for the classical two-stage PD, Afterwards, 
we quantize the game using a known scheme, and then, show how a SGPO can exist that is 
counter-intuitive compared to the classical SGPO for the two-stage repeated PD. 


10.2 Two-stage games of complete but imperfect information 


Like dynamic game of complete and perfect information ~ for example the Stackelberg duopoly 
~ the play in a two-stage game of complete but imperfect information proceeds in a sequence, 
with the moves in the first stage observed before the next stage begins. The new feature is 
that within each stage now there are simultancous moves, ‘The simultaneity of moves within 
each stage means that information is imperfect in the game. A two-stage game of complete but 
imperfect information consists of the steps [108]: 


1. Players A and B simultaneously choose actions p and q from feasible sets P and Q, 
respectively. 


2, Players A and B observe outcome of the first stage, (p,q), and then simultaneously choose 
actions py and gy from feasible sets P and Q, respectively. 
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3. Payofis are Fi(p, 9.71.91) for i= A, B. 


A usual approach to solve a game from this class uses the method of backwards-induction, In 
the last section the first step in working backwards involves solving a single-person optimization 
problem. Now the first step involves solving a simultaneous-move game between players A and 
Bin the second stage, given the outcome from stage one. If the players A and B anticipate that 
their second-stage behavior will be given by (p{(p,q),a¥(P.q)), then the first-stage interaction 
between them amounts to the simultaneous-move game: 


1. Players A and B simultaneously choose actions p and q from feasible sets P and Q, 
respectively. 


2, Payofis are Pi(p, 9,74(p,q) 41(P,9)) for i= A, B. 


‘When (p*,q*) is the unique NE of this simultaneous-move game, the set of four numbers 
(p*, a". Pi(p.@), 1 (P,4)) is known as the SGPO [108] of this two-stage game. This outcome is 
the natural analog of BIO in games of complete and perfect information. 


10.3 Two-stage Prisoners’ Dilemma 


10.3.1 Classical form 


‘We use a normal form of the PD given by the matrix: 


B 
cD 

A ie ( 3) 60} ) (10.1) 
D\ (05) (1) 
The players play this simultaneous-move game twice. The outcome of the first play is observed 
before the second stage begins. Payoff for the entire game is simply the sum of the payoffs from 
the two stages. It is a two-stage game of complete but imperfect information [108]. 

‘Assume players A and B play the pure strategy C with probabilities p and q, respectively, 
in the stage 1. Also assume the players A and B play the strategy C with probabilities pr 
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and qr, respectively, in the stage 2. Call [Pz] and [Poily the payofis to players A and B, 
respectively, in the stage 1, where the symbol cl is for ‘classical’. These payoffs can be found 
from the matrix (10.1) as 

(Pala=—pat4q—p+1,  [Paily=—pa+4p—q+1 (20.2) 


‘The NE conditions for this stage are 


(Pag) Parga 2 — [Par(p*s¢") — ParlP*s gla 20 (20.3) 


giving p* = q* = 0 (Le. defection for both the players) as the unique NE in this stage. Likewise, 
in the second stage the payofis to players A and B are written as [P42], and [Paz], respectively, 
where 


(Pala=—riat4n-m+t,  [Pely=-mn+4m—o+2 (10.4) 


and once again the strategy of defection, ie. pf = gf = 0, comes out as the unique NE in the 
second stage. To compute SGPO of this two-stage game, we analyze its first stage given that 


the second-stage outcome is also the NE of that stage —namely p{ = gf = 0. For this NE the 
players' payoffs in the second stage are 
[Pa2(0,0)a=1, — [Ps2(0,0)J2=1 (10.5) 


‘The players’ first-stage interaction, therefore, in the two-stage PD amounts to a one-shot game, 
in which the payoff pair (1,1) from the second stage is added to their first-stage payoff pair. 
Write the players’ payoffs in the one-shot game as 


[Paccsay]g = [Pa + Pan(0, 0)]y = p+ 4q—p +2 
[Poca] = [Par + Pon(0, 0) = -pa+4p—9+2 (10.6) 


It has again (0,0) as the unique NE. Therefore, the unique SGPO of the two-stage PD is (0,0) 


in the first stage, followed by (0,0) in the second stage. The strategy of defection in both the 
stages comes out as SGPO for the two stage classical PD. 

It is now shown how it becomes possible, in a quantum form of this two-stage PD, to achieve 
‘8 SGPO in which the players decide to cooperate in the first stage while knowing that they 
both will defect in the second. The quantum form of the two-stage PD is played using a system 
of four qubits. Players manipulate these qubits in Marinatto and Weber's scheme to play a 
quantum form of a matrix game. 


10.3.2 Quantum form 


Marinatto and Weber's scheme can be extended to play a two-stage version of a bi-matrix game. 
For example, a quantum version of the two-stage PD starts by making available a four-qubit 
pure quantum state to the players. This state can be written as 


Win) = D> cxnsliskt) where > Jeyuil? =1 02) 
tg ddl 2 Ag kda12 


where i, j,k and 1 are identifying symbols for four qubits. The upper and lower states of a qubit 
are 1 and 2 respectively; and cjja: are complex numbers. It is a quantum state in 2©2@2@2- 
dimensional Hilbert space. We suppose the qubits i and j are manipulated by the players in 
the first stage of the game and, similarly, the qubits k and 1 are manipulated in the second 
stage. Let pix denote the initial state (10.7) in the density matrix formalism. Assume during 
their moves in the first stage of the game, the players A and B apply the identity operator / on 
the initial state with probabilities p and 9, respectively. Also they apply the operator é- with 
probabilities (1—p) and (1—9), respectively. The players’ actions in the first stage changes pin 
to 


ptm = Pala ® lapinl), @ Ih + r(1 —a)in @ Gee pinkl, @ a1 y+ 
U1 -P)t2a® Lopnd! , @ if + (1—p)(1-a)d=a @Sz0pnd!, @3ty 
(10.8) 


‘The players? actions in this stage are simultaneous and they remember their moves (1c the 
numbers p and q) alo in the next stage. In the second stage, players A and B apply the identity 
operator with probabilities and q, respectively, on pyin- The operator xis, then, applied 
with probabilities (1— px) and (1 ~ 41) on pyin, respectively. Fig. (10-1) shows the overall idea 
of playing the two-stage game. Players’ moves in the two stages of the game are done on two 
different pairs of qubits. 

‘After the moves performed in the second stage the quantum state changes to 


prin = Prtcta ® lopped), Op +A - Mla ® Sepppnl Oa! yt 
(1 —prdéca @ Inpyindt, @ T+ 
(1 pi) - nea @ Fenpjind, @ Aly (10.9) 


which is ready for measurement, giving payofis for the two stages of the game. If classically 
the bi-matrix game (10.1) is played at each stage, the possession of the following four payott 
operators by the referee corresponds to a ‘quantum version’ of the two-stage game: 


[CPs = E,omomte 5 fuk (uA +- [22k (22K) 
(Ce = jan) (ejna} + 5 fip2a) (24201 + 1522) (6522) 
[dee] = Zp, oHmsg aut steahoa+ (paki 22k} 
[C0 = 2 {3 ign) (ajua] + 516522) (4422 + 15922) (69221) 


(10.10) 


‘The corresponding payoffs are, then, obtained as mean values of these operators. For 
example, Alice's payoff in stage 1 is 


[Paalen = T{ [(PAoe] 2286} (10.12) 
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Figure 10-1: Playing a two-stage quantum game of Prisoners’ Dilemma, 


‘We consider a two-stage quantum PD played with pure four-qubit initial state in the form: 


Ions) = x [1111) + ep 1122) + 3 |2211) + cy |2222) (10.12) 


4 
with 5° lal? = 1. For this state the payoffs to the players A and J in the two stages are found 
as 


(Patleu = (lel? + leal?)(—pa - p+ 49+ 1+ 
(leaf? + leal?)(—pa+ 2p ~ 84 +3) 
[Paalgn = (lerl? + leal?)(—pron ~ pr + 4qn + 1)+ 
(leaf? + leal?)(—pitn + 2p - 3m. +3) 
(Palys = (lel? + leal?)(—pa — 9+ 4p + 1)+ 
(eal? + leal?)(—pa + 29 ~ 3p +3) 
(Paalgy = (lea? + leaP?)(—mran ~ an +4P1 + 1)+ 
(leal* + leaP)(—pren +2 — 3p +3) (10.13) 


‘The players’ payoffs in the classical two-stage PD given by Eqs. (10.2, 10.4) can now be 
recovered from the Eq. (10.13) by taking |c;|? = 1. The classical game is, therefore, a subset 
of its quantum version. 

One now proceeds, in the spirit of backwards-induction, to find a NE in the second stage of 
the quantum game. Suppose (pj, 9f) is a NE in the second stage, then 


[Pali at) ~ Paa(Pr,ai)lu 2% —— [Paalpis a1) ~ PaalPisa1)lgu 2 0 (10.14) 


With the players’ payoffs of the two stages given by Eq. (10.13), the Nash inequalities (10.14) 
can be written as 


(t—m) {-af +20? + lal?) - (al? + lel?)} 20 
(at ~ 01) {Pt + 2(eal* + lea") ~ eal? + lea) } 2 0 (10.5) 


and the strategy of defection by both the players, i.e. pj = of = 0, becomes a NE in the second 
stage of the quantum game, if 


{21a + lea?) ~ (lal? + lal) } <0 (10.10) 


Similar to the classical analysis, players’ payoffs can be found when both decide to defect in 
the second stage: 


[P2(0,0)lqu = [Po2(0,O)lpy = S(leal® + lea?) + (lel? + lea?) (10.17) 

‘The classical payoffs, when both players defect, of the Eq. (10.5) can be recovered from Eq. 
(10.17) when {c;|? = 1, i.e. for an unentangled initial state. 

Similar to the classical case the players’ first-stage interaction, in the two-stage quantum 

PD, amounts to a one-shot game. In this one-shot game the payoff 3{lea|?+le4!*)+(lal?-+leal*). 
from the second stage, is added to their first-stage payoffs: 


[Pacr+ay] gy = [Par + Paa(0, Ogg = leal? (—pa+ 4g — p+ 2)+ 
leal? (—pa + 4q — p+ 4) + |eal® (pq — 39+ 27+ 4)+ 
leal? (-pa — 39 + 2p +6) 
[Paci+2)] 9, = [Par + P20, 0) qq = lerl® (a+ 4p - 9+2)+ 
leal? (—pa+ 4p ~ 9+ 4) + leal® (~pa- Sp-+ 29+ 4)+ 
leal? (~pq- 3p + 29 +6) (10.18) 


‘The strategy of cooperation (that is p} = gf = 1) can now be a NE for the first-stage interaction 


ui 


in this two-stage quantum game, if 


{2tlel? + lea?) ~ (lal? + lea} <0 (10.19) 


‘The inequalities (10.16) and (10.19) are the conditions on the initial state when the players 
cooperate in their first-stage interaction while both defect in the next stage. These conditions 
can be rewritten as 


1 1 
laP+leP <3, la +lal* <5 (10.20) 


For example, at |c:|” = Jea{” = cal? = } and |cq|” = } these conditions hold. Because for 
the classical game the inequalities (10.20) together cannot hold, showing why classically it is 
not possible that players cooperate in the first stage knowing that they both will defect in the 


second. 


10.4 Discussion 


Essentially, the repeated games differ from one-shot games in that players’ current actions 
can depend on their past behavior. In a repeated bi-matrix game the same matrix game is 
played repeatedly, over a number of stages that represent the passing of time. The payoffs are 
‘sccumulated over time. Accumulation of information about the “history” of the game changes 
the structure of the game with time. With cach new stage the information at the disposal of 
the players changes and, since strategies transform this information into actions, the players’ 
strategic choices are affected. Ifa game is repeated twice, the players’ moves at the second stage 
depend on the outcome of the first stage. This situation becomes more and more complex as the 
‘number of stages increases, since the players can base their decisions on histories represented 
by sequences of actions and outcomes observed over increasing number of stages. 

Recent findings in quantum game theory motivate a study of repeated games in the new 
quantum setting. It is because useful and extensive analysis of repeated games is already found 
in literature of classical game theory. In present chapter — to look for a quantum role in repeated 
games — we consider a quantum form of a well-known bi-matrix game of PD. 


Classical analysis of the PD has been developed in many different formats, including its 
finitely and infinitely repeated versions. In the history of quantum games the PD became a 
focus of early and important study [20] telling bow to play a quantum form of s bi-matrix 
game. To play a quantum form of repested PD we select Marinatto and Weber's scheme. In 
this scheme a repeated game is played when the players select positive numbers in the range 
[0,1], giving the probabilities with which they apply the identity operator f on a four-qubit 
pure quantum state. The players’ actions in each stage are performed on two different 
airs of qubits. The classical two-stage PD corresponds to an unentangled initial state, and the 
classical SGPO consists of players defecting in both the stages. It is shown that a SGPO where 
the players go for cooperation in a stage is a non-classical feature that can be made to appear 
in quantum setting. 

‘The argument presented here is based on the assumption that other games, resulting from 
a play starting with a four-qubit quantum state of the form of the Eq. (10.7), are ‘quantum 
forms’ of the classical two-stage game. This assumption originates from the fact that the 
classical game corresponds to a particular four-qubit pure quantum state which is unentangied. 
‘The assumption makes possible to translate the desired appearance of cooperation in a stage 
to certain conditions on the parameters of the initial state, thus giving a SGPO where players 
decide to cooperate in their first-stage interaction while they both defect in the next stage. 

‘One may ask about the compelling reason to choose a 2@2@2@2 dimensional Hilbert 
space instead of a 2@2 dimensional one. A 22 dimensional treatment of this problem, in the 
same quantization scheme, involves denominator terms in the expressions for payoff operators, 
when these are obtained under the condition that classical game corresponds to an unentangled 
initial state. It then leads to many ‘if-then’ conditions before one gets finally the payoffs. On 
the contrary, a treatment in 2@2@2@2 dimensions is much smoother. Also a study of the 
concept of SGPO in a two-stage repeated quantum game, then, becomes a logical extension of 
the backwards-induction procedure proposed in the last chapter. 


Chapter 11 


New proposals to play quantum 


games 


11.1 Introduction 


Meyer [19] and Du et al. [109] have shown that entanglement may not be essential for a quantum 
game. Eisert et al.'s quantum PD was the first proposal where entanglement was used as a 
resource. There has been noticeably greater attention paid in exploiting entanglement for 
quantum games. It is not unusual and can be traced back to exciting and counter-intuitive 
Properties of this phenomenon, as well as to its recent enthusiastic investigation in quantum 
information theory [21]. 

Local unitary manipulations of entangled qubits to play matrix games is indeed an interest- 
ing concept that gives new dimensions to classical game theory. But it does not forbid the use 
of other quantum mechanical effects to play other ‘quantum forms’ of matrix games - games 
for which extensive analysis in the classical domain already exists in literature (104, 108]. A 
look at the Eisert et al.'s set-up [20, 46] makes apparent some of its similarities to well-known 
‘Young's double-slit apparatus {110]. Simultaneous and local unitary manipulation of a maxi- 
mally entangled two-qubit quantum state, and its later measurement, is the essential feature of 
Eisert et al.'s set-up. In Young's double-slit set-up, however, coherent light passes through two 
slits to form a diffraction pattern on a screen facing the slits. Similarity between these setups 
becomes noticeable if a comparison is made between: 
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‘© The properties of entanglement and coherence. 
+ Players’ moves in manipulations of qubits and the process of opening or closing the slits. 
‘« Wavefunction-collapsing measurement and the appearance of the diffraction pattern, 


Such a comparison, in its turn, asks for a quantum feature that can be exploited to give new 
dimension to a matrix game, when it is played using a Young’s double-slit like apparatus. In 
Eisert et al.'s set-up this quantum feature is obviously the quantum phenomenon of entangle- 
ment. In Young’s apparatus this feature is the association of wave-like properties to material 
objects like electrons, producing a diffraction pattern on a screen. Section (11.2) exploits such 
sssociation of waves as a resource to play quantum versions of classical games. 

Playing of a game requires resources for its physical implementation. For example, to 
play a bi-matrix game the resources may consist of pairs of two-valued ‘objects’, like coins, 
distributed between the players. The players perform their moves on the objects and later a 
referee decides payoffs after observing the objects. Game theory usually links players’ actions 
directly to their payofls, without a reference to the nature of the objects on which the players 
have made their moves. However, playing quantum games [20] show that radically different 
‘solutions’ can emerge when the same game is physically implemented on distributed objects 
which are quantum mechanically correlated. 

In Section (5.4) Enk and Pike's argument [73] is briefly discussed. Essentially it says that 
the emergence of new equilibrium in quantum Prisoners" Dilemma can also be understood as an 
equilibrium in & modified form of the game. They constructed another matrix game, in which 
players have access to three pure classical strategies instead of the usual two, commenting that 
it ‘captures’ everything quantum Prisoners’ Dilemma has to offer. Constructing an extended 
matrix with an extra pure classical move, in their viow, is justified because also in quantum 
Prisoners’ Dilemma players can play moves which are superpositions of the two classical moves. 

‘Truly quantum pairs of objects possess non-local correlations. Though it is impossible to 
have a local model of a quantum game set-up, producing exactly the same data, but how 
such unusual correlations may explicitly affect solutions of a game when implemented with 
quantum objects. ‘To how far extent solutions of a quantum game themselves can be called 
‘truly quantum’ in nature. Section (10.3) tries to address these questions. 
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11.2 Quantum games with a diffraction set-up 


Historically speaking, the De Broglie's original ides (110, 111] - that travelling material particles 
have waves associated with them - was undoubtedly the key concept behind the development of 
quantum physics in early part of the twentieth century. Soon afterwards, Davisson and Germer 
[110] verified the idea in their experimental demonstration of the diffraction of electrons by 
crystals. De Broglie’s proposed that a travelling electron with momentum p has an associated 
wave of wavelength \ = h/p, where h is the Plank’s constant. To make A a measurable quantity, 
under normal laboratory conditions, the momentum p should have similar order of magnitude 
as h. h being a very small quantity shows why it is very hard to detect waves associated with 
macroscopic objects. Our motivation is to take this quantum feature ~ associating wave-like 
properties to micro objects ~ as a resource that can be used to play a quantum game. Such a 
quantum game can be realized using an apparatus consisting of travelling electrons, multiple 
slits intercepting them, and a resulting diffraction pattern, In this set-up a player’s choice of a 
‘pure strategy’ consists of opening or closing slits at his/her disposal. Suppose the apparatus 
is adjusted such that when A approaches zero the classical game is reproduced. It can then be 
argued that because an observation of a value of A quite away from zero is entirely a quantum 
feature, therefore, the resulting different payoffs for the players correspond to # quantum form 
of the classical game. In this setup the players’ payoffs are to be found from the diffraction 
pattern formed on the screen. We show the possibility of finding a value for \ that makes 
appear @ non-classical equilibrium in the PD when the players play only the pure strategies. 
‘The classical game remains a subset of its quantum version because with A approaching zero 
the classical game is reproduced. 

‘The motivation to play a quantum form of PD, without using the phenomenon of entan- 
sglement, also derives from Feynman's excellent exposition [112] of quantum behavior of atomic 
objects, He describes and compares the diffraction patterns in two similar set-ups that are 
imaginary but experimentally realizable. The two set-ups consist of bullets and electrons pass- 
ing through a wall with two slits. Feynman then describes the well-known quantum property ~ 
associating waves to all material particles ~ to distinguish the diffraction patterns of bullets and 
electrons. The disappearance of a pattern for the bullets, he explains, is due to tiny wavelengths 
of the associated waves, For such waves the pattern becomes very fine and, with a detector 
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of finite size, one cannot distinguish the separate maxima and minima, We ask why not to 
play a game, in the Feynman's imaginary experimental set-up, such that the classical game 
corresponds when, in Feynman's words, bullets are fired; and a quantum game corresponds 
when electrons replace the bullets. 


11.2.1 Playing Prisoners’ Dilemma 


We select the PD to be played in a diffraction set-up, The classical PD, in its general form, is 
represented by the following matrix: 


Bob 
cD 
lice © ( Soy } (ua) 
D \ (ts) (uu) 

where t > > u > s. To make the classical game imbedded in its quantum version the positive 
coefficients u,r,s and t, appearing in the matrix, (11.1), are translated into distances between 
the slits. Each player is in control of two slits such that his/her strategy consists of opening 
‘one of the slits and closing the other. For example, if Alice decides to cooperate then she 
‘opens the slit C and closes the slit D. Because Bob has a similar choice, therefore, all possible 
moves by the players leads to the opening of two slits and closure of the other two, with the 
separation between the two open slits depending on the moves of the players. ‘Tt happens when 
only the so-called ‘pure-strategies’ can be played by the players, which in the present setup 
means to open a slit and close the other. Now, at the final stage of the game, the action of the 
arbiter — responsible for finding the payoffs when the players have made their moves ~ consists 
of measuring the distance between two peaks of the diffraction pattern. This peak-to-peak 
distance is known [110] to be A/d, where d is the separation ‘between the open sits and 2 is 
the wavelength associated with the bombarded material objects, like electrons. Payoffs to the 
players are functions of A/d and it, then, explains why it is useful to translate the coefficients 
of the matrix of the classical game into the separations d between the slits. ‘When bullets are 
fired, which means the particles become heavier and corresponding A is very nearly zero, the 
payoffs become classical and depend only on d i.e, the separation between the slits. A payoff 
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Figure 11-1: A multi-slit diffraction set-up to play a quantum form of Prisoners’ Dilemma. A 
window with four slits faces an electron source. Bach player has access to two slits. A player 
plays a pure strategy by opening a slit and closing the other. Referee finds the players’ payoffs 
by measuring the peak-to-peak distance on the diffraction pattern formed on the screen, 


representation in terms of \/d contains both the classical and quantum aspects of the matrix 
game played in this set-up. The experimental set-up shown in the Fig. (11-1) sketches the 
diffraction set-up to play a quantum game. 

For PD the payoffs are symmetric for the players and a single equation can describe the 
Payofls to both the players when their strategies are known. A usual way to express it is to 
write P(s1,82) for the payoff to the s,-player against the s2-player. Such a single ‘equation 
Yepresentation is usually used in evolutionary games [32] consisting of symmetric biematrix 
conflicts. The s;-player is referred to as the ‘focal’ player and the sy-player as just the ‘other’ 
player. The PD is one such example for which a single payoff equation can capture the essence 
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of the idea of a symmetric NE. A strategy s* is a symmetric NE if 


P(s*,s*)— P(s,s*)>0, foralls (2) 


saying that the focal player cannot be better off by diverging away from s*. Because the set-up 
of the Fig. (11-1) involves coefficients in the classical payoff matrix corresponding to the first 
player, therefore, finding a symmetric NE with Eq. (11.2) becomes immediately possible when 
the first player is taken as focal. It also shows why writing payoff as P(s1, #2) is relevant to the 
set-up of the Fig. (11-1). For example, classically the strategy of defection D is a symmetric 
NE because P(D,D) ~ P(C,D) = (u—s) > 0, where the players’ moves consist of only the 
pure strategies, 

In the set-up of Fig. (11-1) for every pure strategy move the players have option to play, a 
unique separation d between the slits is obtained that can have four possible values ie. u,r,s 
or t, Classically P(C,C) = r, P(C,D) = s, P(D,C) = t snd P(D,D) = w. It is observed in 
the Fig, (1-1) that the classical payoff to the focal player, against the other, can be equated 
to the separation between the two open slits d. 

Now assume thet instead of simply P(s1, $2) = d the arbiter uses the payoff equation: 


P(s1, 82) = d +k(A/d) (11.3) 


where k is a positive constant that can be called a scaling factor. P(s),82), obviously, reduces 
to its classical counterpart when 2 is very nearly zero. Suppose the strategy of cooperation C 
is a symmetric NE: 


P(G,C) — P(D,C) = {kA(1/r — 1/8) - (t—r)} 20 (11.4) 


It requires > rt/k. For electrons of mass m travelling with velocity v it gives v < (kh/mrt). 
‘Supposing r and ¢ are both non-zero, the arbiter's problem consists of finding an appropriate 
value for the scaling factor k that brings v into a reasonable range from experimental point 
of view. When the electrons have associated wavelength > rt/k the strategy of cooperation 
becomes a symmetric NE, and each player gets a payoff r+ kA/r. Similarly when the pure 


strategy of defection is a symmetric NE in the quantum game, we have 


P(D,D) — P(C,D) = {-kX(1/s ~ 1/u) +(u-s)} 20 (11.5) 


Tt requires \ < su/k. After the scaling factor k is decided the wavelength \ determines which 
pure strategy should be a symmetric NE. Two ranges for A can be indicated as 4 < su/k 
and A > rt/k. Defection and cooperation are symmetric NE for these ranges, respectively, 
Because the constants z,r,u, and k are all positive the classical game is in the first range of 
2. Non-classical equilibrium of cooperation shows itself in the second range of A. 

Du et als recent analysis 113] of the quantum PD, with players’ access to Eisert's two- 
parameter set of unitary operators, has shown an intriguing structure in the game as a function 
of the amount of entanglement. ‘The game becomes classical when the entanglement vanishes. 

In the set-up of Fig. (11-1) the quantity \ behaves in a way similar to the amount of 
entanglement in Du et al.’s analysis (113, 114). But this set-up is devoid of the notion of 
entanglement and relies instead on a different. quantum aspect. An aspect which is as much 
‘quantum’ in nature as the phenomenon of entanglement for qubit systems, 

‘There is however a difference, to be noticed, between the set-ups of Eisert et al. and that 
of the Fig, (11-1). Players’ actions in Eisert et al.'s set-up are quantum mechanical in nature 
in that they make moves with quantum operators, In the present set-up, on the contrary, 
the players’ actions are entitely classical consisting of opening or closing slits. In a sense it is 
similar to the players’ actions in Marinatto and Weber's scheme. In their scheme players possess 
‘quantum operators but they apply them on an initial quantum state with classical probabilities; 
so that the players’ moves can be considered classical as well. It can be said that, apart from 
the work of Bisert et al., the set up of Fig. (11-1) is also motivated, to an almost equal extent, 
by the Matinatto and Weber's idea of playing a quantum version of a matrix game. 


11.3 Performing EPR type experiments to play a bi-matrix 


game 


‘To address the question raised in the Section (11.1), ic. to how much extent a quantum game 
can be called ‘truly quantum’, following two constraints are suggested [115] which a quantization 
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scheme should follow: 
(C1). In both classical and quantum version of the game the same set of moves should be 
made available to the players, 
(C2). The players agree together on explicit expressions for their payoffs which must not 
be modified when introducing the quantized version of the game. 
With these constraints one can hope that only the nature of correlations, existing between 
the objects the players receive, will decide whether the resulting geme is classical or quantum. 
Consider a symmetric bi-matrix game between two players Alice and Bob with the matrix 


representation: 


Bob 
A 
St (nr) (st) 
Sa (4s) (uu) 
For which the mixed strategy payoffs for the players'can be written as 


(11.6) 


Palp.q) = Kpq+ Lp+Mq+N 
Pa(p,q) = Kpq-+ Mp+ La +N (7) 


where the constants K,1.,M and N can be found in terms of r,5,¢ and w, the coefficients of 
the bi-matrix (11.6). The NE defining conditions are 


Pal". a) - Pala’) 20 
Pa(p", a") — Pa(p",q) 20 (11.8) 


For example, for PD we may have r = 3,5 =0.t= 5 and u= 1 that reduce the inequalities 
(11.8) to 
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(-p)(L+a°) <0 
(@ —g)(t +p") <0 (11.9) 


It produces p* = q” = 0 or (D, D) as the unique equilibrium. 


11.3.1 Quantum correlation games 


‘The idea of a ‘correlation game’ in the Ref. [115] was introduced to put forward a scheme to play 
‘8 quantum version of a bi-matrix game that respects the constraints C1 and C2 of the Section 
(us ). Its motivation comes from EPR type experiments performed on singlet states involving 
correlations of the measurement outcomes. In such experiments the Bell's inequalities [38] are 
well-known to be the constraints ~ derived under the principle of local causes ~ on correlations 
of measurement outcomes of two-valued (dichotomic) variables. ‘Truly quantum correlations 
are non-local in character and violate the inequalities. 

‘The two parties involved in the usual EPR type setting are recognized as the players. 
Repeated measurements are performed on correlated pairs of objects by the two players, each 
receiving one half. 

Players Alice and Bob share a Cartesian coordinate system between them and each player's 
move consists of deciding a direction in a given plane. For Alice and Bob these are the 2-2 and 
2 planes respectively. Call a and i the unit vectors representing the players’ moves. Both 
players have a choice between two different orientations ie. @ and z for Alice and # and z for 
Bob. Each player measures the angular momentum or spin of his/her respective half in one of 
‘two directions. Let the vectors a and # make angles 04 and Op, respectively, with the z-axis, 

To link the players’ moves, represented now by angles @4 and p, to the usual probabilities 
p and q appearing in a bi-matrix game, an invertible function g is made public at the start of 
4 game. ‘The g-function maps (0,] to (0, 1] and allows to translate the players’ moves to the 
probabilities p and g. 

The results of measurements performed on dichotomic variables may take only the values 
241 ‘These are represented by a,b and c for the directions a, and the z-axis respectively. 
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Correlations (ac), (cb) and (ab) can then be found from the measurement outcomes, where the 
‘two entries in a bracket represent the players’ chosen directions, 

In a correlation experiment in which the z-axis is the common direction for the players, the 
Bell’s inequality’ is written [38] as 


(ab) — (ac)| <1 — (be) (11.10) 


The classical correlations corresponding to the above situation, when written in terms of 84 
and Oj, are known [38] to be invertible, This invertiility allows to express 04 and 0g in terms 
of the correlations (ac) and (ct). The g-function allows now to translate 84 and @g to p and q, 
respectively. In effect the classical bi-matrix payoffs are re-expressed in terms of the classical 
correlations (ac) and (ct). 

One can now claim that the classical game is given by definition in terms of the correlations. 
‘The point for such a re-expression of the classical game is that it opens the way to ‘quantum’ 
version of the game. It, of course, happens when the correlations become quantum mechanical. 

In the setting of a correlation game the players’ payoffs involve only the correlations (ac) 
and (ct), instead of the three correlations (ac), (cb) and (ab) present in the inequality (11.10), 
when z-axis is the common direction between the players. This aspect results in [115] obtaining 
‘quantum’ payoffs even when the correlations are local and satisfy the inequality (11.10). 

‘The motivation for introducing EPR type setting to bi-matrix games is to exploit quantum 
correlations to generate quantum payoffs. So that, when the correlations are local, the classical 
game must be produced. We show below the possibility of such connection by a different 
setting in which the classical payofls are always obtained whenever the correlations (ac), (cb) 
and (ab) satisfy the Bell's inequality (11.10). 


11.3.2 A new approach towards defining a correlation game 
Consider an EPR type set-up to play a game between two players. Following rules apply: 


1. A player's move consists of defining a direction in space by orientating a unit vector, 
However, this direction is not confined to only the x-z or y-z planes. A player's choice 


"For perfectly anticorrelated pairs the right hand side of the inequality is 1+ (be). 
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of a direction can be anywhere in three-dimensional space. Therefore, Alice's move is to 
define a unit vector a and, similarly, Bob's move is to define a unit vector . 


2. The z-axis is shared between the players as the common direction, 


3. On receiving half of a correlated pair, a player measures its spin in one of the two 
directions. For Alice these directions are a and z and for Bob these directions are 2 and 


x 
4. Each player measures spin with equal probability in his/her two directions. 


5. Players agree together on explicit expressions giving their payoffs P4 and Pp in terms of 
all three correlations ie. 


Pa = Pa((ac), (cb), {ab)) 
Pa = Pa((ac), (cb), {ab)) (11.11) 


A game defined by these rules eliminates the need for introducing the g-functions. The rules 
are also consistent with the constraints C1 and C2 and the idea of a corelation game easentally 
retains ite spirit, 


11.3.3 Defining correlation payoffs 


A possible way is shown now to define the correlation payoffs (11.11) which reduce to the 
Classical payoffs (11.7) whenever the correlations (at), (ac) and (be) satisfy the inequality (12.10). 
Consider two quantities € and o defined as: 


= VIF CPE RabNac), 9 = VAI (ley) + (ad) F (acy? (11.12) 
‘The quantities ¢ and ¢ can adapt only real values because the correlations (ac), (cb) and (ab) 
‘re always in the interval [-1, 1}. Consider now the quantities (¢~c) and (e+-a). By definition 
€ and ¢ are non-negative, therefore, the quantity (¢ +) always remains non-negative, Tt 
's observed that if 0 < (e~) then the correlations (ac), (cb) and (ab) always satisly the 
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inequality (11.10). It is because if 0 < (e~a) then 0 < (e +0)(e- 0) = e2-o0%, But 
eh — 0? = (1 ~ (be)? ~ |(ab) — (ac)? 80 that |(ab) ~ (ac)|* < (1 ~ (be))® which results in the 
inequality (11.10). All the steps in the proof can be reversed and it follows that whenever 
the correlations (ac), (cb) and (ab) satisfy the Boll's inequality, the quantity (c —¢) remains 
non-negative 

For a singlet state satisfying the inequality (11.10) both the quantities (e+) and (e-) are 
non-negative and must have maxima, Hence, it is possible to find two non-negative numbers 
miegetay and Et, in the range [0,1], whenever the inequality (11.10) holds. Because 
0 <e,0 < V6 we have max(e—o) = V6 and max(e +a) = 2V6. ‘The numbers (¢ ~ ¢)/V6 
and (€ +0)/2V6 are in the range [0,1] when the inequality holds. ‘These numbers are also 
independent from each other. 

‘The above argument paves the way to associate a pair (p,q) of independent numbers to the 
players’ moves (a, 8), that is 


P=P(a,A), 9 =4(a,A) (11.13) 


where the numbers p,q are in the interval [0,1] when the input states do not violate the in- 
equality (11.10) for all direction pairs (a, f). ‘The pair (p,q) is related to the two directions 
as 


a=alpa), A = Alp.) (1.14) 


It can be noticed that more than one pair (a,) of directions may, however, correspond to a 

given pair of numbers. ‘The converse, although, is not true for known input states. ‘That is, for 

Known input states, only one pair (p,q) can be obtained from a given pair (a, 8) of directions. 
Players’ payoffs can now be re-expressed by making the replacements: 


P(a,8) ~(e-0)/V6, q(a,A) ~(e+0)/2V6 (1.15) 


which lead to re-writing the classical payoffs (11.7) as 


Pala.) = Kp(a, A)a(a, 6) + Lp(a) + Mala, 8) +N 
Pa(a,B) = Kp(a, A)q(a, 8) + Mpa, 8) + La(a, 8) +N (21.16) 


or more explicitly: 


Palosb) = le ~08)+ leo) + Melee) +N 


PalesA) = le ~ 08) + Heo) + leo) +N (17) 


‘This expression shows that a player's payoff now depends on the direction s/he has chosen. The 
payoffs (11.17) are obtained under the constraints C1 and C2 and are functions of all the three 
correlations. 

‘The relations (11.13) can also imagined as follows. When Alice decides a direction a in 
space, it corresponds to a curve in the p-g plane. Similarly, Bob's decision of the direction 
defines another curve in the p-g plane, The relations (11.15) assure that only one pair (p,q) 
can then be obtained as the intersection between the two curves. 

‘The set-up assures that for input product states all of the players’ moves (a, A) result in 
the correlation payofis (11.17) generating identical to the classical payoffs (11.7). For such 
input states the relations (11.15) give the numbers p,q in the interval {0,1}, which can then 
be interpreted as probabilities. However, for input states for which the inequality (11.10) is 
Violated in some directions, a pair (p,q) € [0,1] cannot be associated to those directions. It is 
because for entangled states there exist pairs of directions for which the corresponding quantity 
(€ 2) becomes negative. For those directions the correlation payoffs (11.17) would generate 
results that can only be understood, within the structure of classical payoffs (11.7), by invoking 
negative probabilities 


11.3.4 Nash equilibria of quantum correlation games 


Because the players’ moves consist of defining directions in space, the Nash inequalities are 
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Pa(ao, Bo) — Pa(ar, fo) 20 
Pala, fo) ~ Paco, f) 20 (11.18) 


where the pair (ag, fo) corresponds to the pair (p*, q*) via the relations (11.15). The inequalities 
(11.18) are same as the inequalities (11.8), except their re-expression in terms of the directions. 

When the correlations in the input state correspond to an entangled state, the payoff rela- 
tions (11.17) would lead to disappearance of the classical equilibria. It can be seen, for example, 
by considering the Nash inequalities for the Prisoners Dilemma (11.9). Let the directional pair 
(ap, fo) correspond to the equilibrium (D,.D), that is, the inequalities (11.18) are 


Palap, Bp) - Pala, Bp) 20 
Pp(ap, hp) - Palap, 6) >0 (11.19) 


Assume the players receive input states that are entangled. ‘There will now exist pairs of players’ 
‘moves a and i that would make the quantity (¢ ~ a) <0. ‘The pair (a, A) will not correspond 
to a point in the p-g plane where p,q € (0, 1}. 

Tt can also be noticed that for entangled input states the directional pair (ap, fp) does not 
remain a NE, Tt is because the pair (ap, Ap) is a NE only if players’ choices of any directional 
pair (a, A) corresponds to a point in the p-9 plane where p,¢ € [0,1]. 

Because for entangled input states there exist pairs of players’ moves (a, 8) that do not 
correspond to points in the p-q plane with p,q € [0,1]. Hence, the directional pair (ap,fp) 
does not romain a NE in the quantum game. Interestingly, the disappearance of the classical 
equilibrium now becomes directly linked with the violation of the inequality (11.10) by the 
correlations in the input states. 
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11.3.5 Quantum game as another classical game? 


Coming back to the questions raised in the Section (11.1), we now try to construct a classical 
bi-matrix game corresponding to a quantum game resulting from the payoff relations (11.17). 
‘The classical game is assumed to have the same general structure of players’ payoffs as given in 
Eqs. (11.7). This assumption derives from the hope that the quantum game, corresponding to 
correlations in the input states that violate the inequality (11.10), is also equivalent to another 
symmetric bi-matrix game. It is shown below that such a construction cannot be permitted. 

Suppose the correlations in the input states violate the inequality (11.10). A pair of direc- 
tions (a, A) can now be found for which the Bell's inequality is violated. For Alice's move to 
select the direction a her payoff, given by the Eqs. (11.17), is 


Pa(a, 6) = K'pq + L'p+ Mg +N (11.20) 


where K' = —K and L! =—L and p,q € [0,1]. Assuming that the constants K’,L’,M, and N 
define a ‘new’ symmetric bi-matrix game the Bob's payoff is 


Pa(p,q) = K'pq+ Mp+L'qg+N (11.21) 


But in fact (11.21) is not obtained as the Bob's payoff in our quantum game when he goes for 
the direction 8. Bob's payoff is, in fact, given as 


Palp,q) = K'pq+ M'p+ Lq+N (11.22) 


which may not necessarily coincide with the payoff given in the Eq. (11.21). Hence, the 
game resulting from the presence of quantum correlations in the input states cannot be simply 
explained as another classical symmetric bi-matrix game: a game obtained by defining new 
coefficients of the matrix involved. Players’ payoffs in the quantum game are found to reside 
outside the structure of payoffs in a classical symmetric bi-matrix game. The payoffs can be 
explained within this structure only by invoking negative probabilities. 

‘An asymmetric bi-matrix game can, of course, be constructed having identical solutions to 
the quantum game. In fact for eny quantum game a classical model can always be constructed 
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that summarizes the complete situation and has identical to the quantum solutions, as far as 
the players’ payoffs are concerned. It would be a model that relates players’ moves to their 
payoffs in accordance with the usual approach in game theory. But constructing such a model is 
not an answer to our original question: How solutions of a game are affected by the presence of 
quantum correlations between the physical objects used to implement the game? It is because 
the question can then simply be rephrased as: What if the modified classical game is played 
with physical objects having quantum correlations? 


11.3.6 Discussion 


‘The idea of a correlation game is about re-expression of payoffs of a classical bi-matrix game in 
terms of correlations of measurement outcomes made on pairs of disintegrating particles. ‘The 
‘measurement outcomes are dichotomic variables and their correlations are obtained by averaging, 
over a large number of pairs, Bell's inequalities represent constraints on these correlations 
obtained under the principle of local causes. A re-expression of the classical payoffs of a bi- 
matrix game in terms of correlations opens the way to explicitly see the effects of quantum 
correlations on the solutions of the game, 

‘We have proposed a new setting where two players play a bi-matrix game by repeatedly 
performing measurements on correlated pairs of objects. ‘The setting is motivated by EPR 
type experiments performed on singlet states. On receiving a half of a pair, a player makes a 
‘measurement of its spin in one of the two directions available to him/her. The measurements are 
performed with equal probability in the two directions. Both players share a common direction 
and defining the other direction is a player's move, 

‘We show how within this set-up a correlation version of a symmetric bi-matrix game can be 
defined. The correlation game shows some interesting properties. For example the correlation 
game reduces to the corresponding classical game when the correlations in the input states 
are local and do not violste the Bell's inequality (11.10). However, when the inequality is 
violated, the stronger correlations generate results that can be understood, within the structure 
of classical payoffs in a symmetric bi-matrix game, only by invoking negative probabilities, 
It is shown that a classical NE is affected when the game is played with input states having 
quantum correlations. ‘The proposed set-up also provides a new perspective on the possibility of 
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reformulating the Bell’s inequalities in terms of a bi-matrix game played between two spatially- 
separated players. 
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Chapter 12 


Conclusions 


‘To conclude a summary of the results developed in this thesis is presented below. The results 1 
~ 8 refer to Eisert et al.’s and Marinatto and Weber's schemes of quantization of matrix games. 


1, In a population engaged in symmetric bi-matrix classical game of Prisoners’ Dilemma an 
invasion of classical ESS is possible by the mutants exploiting Kisert's two-parameter set of 
quantum strategies. We presented an example of an asymmetric quantum game between 
‘two players in which a strategy pair can be an ESS for either classical or quantum version 
of the game, even when it remains a NE in both the versions, It shows quantization can 
change evolutionary stability of Nash equilibria in certain asymmetric bi-matrix games. 


2, ESS concept was originally defined for symmetric bi-matrix contests. We showed that 
‘quantization can also change evolutionary stability of a NE in certain types of syrnmetric 
bi-matrix games. It immediately makes study of quantum games also relevant to evolu- 
tionary game theory and conversely. Hence, quantization not only leads to new equilibria 
but it also presents itself also as another refinement notion of the NE concept. 


= 


Like pure strategies the evolutionary stability of mized strategies can also change as a 
symmetric bi-matrix game is switched from its classical to quantum form. However, for 
mixed strategies we require more general initial quantum states, 


4. Rock-Scissors-Paper (RSP) is a two-player throestrategy game. We consider a slightly 
modified form of RSP played in its classical version. A mixed NE exists that is not an 
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ESS. We find: quantum form of the same game in which the classical NE becomes an 
ESS. The quantum form is obtained when the game is played with an initial entangled 
state. 


Quantization can change properties of equilibria of replicator dynamics. ‘We consider a 
same played in a population setting with the underlying process of replicator dynamics, 
We found a ‘quantum form’ of the replicator equations, which retain their form as that of 
Lotke-Volterra type. ‘The effects of quantization of the game on a saddle or a center of the 
dynamics are then studied. It's found that a saddle (center) in the classical game can be 
a center (saddle) in certain quantum form of the game. A saddle or center in a classical 
(uantum) game can not be, however, an attractor or a repellr in quantum (clasical) 
form of the game. 


A symmetric cooperative game played by three players is analyzed in its classical and 
quantum forms. In classical form of this game forming a coalition gives advantage to 
Players and players are motivated to do so, In quantum form of the game, however, an 
initial quantum state can be prepared by the arbiter such that forming the same coalition 
is of no advantage. 


‘A comparison between the NE in Cournot game with the backwards-induction outaome in 
classical Stackelberg duopoly shows that having Alice (who acts first) know that Bob (who 
acts second) knows Alice's move hurts Bob. In fact in classical version of the Stackelberg 
game Bob should not believe that Alice has chosen its Stackelberg quantity, We have 
shown that there can be a quantum version of Stackelberg duopoly where Bob is not hurt 
ven if he knows the quantity chosen by Alice. The backwards-induction outcome of this 
‘Quantum game is same as the NE in classical Cournot game, where decisions are made 
simultaneously and there is no such information that hurts a player. 


In infinitely repeated versions of the classical game of Prisoners’ Dilemma itis established 
[108] that cooperation can occur in every stage of a subgame-perfect outcome (8GPO), 
ven though the only NE in the stage game is defection. We find how cooperation in two- 
stage Prisoners’ Dilemma can be achieved by quantum means. In two-stage Prisoners’ 
Dilemma getting a SGPO where players cooperate in the frst stage is a result with no 
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classical analogue. We have also introduced a possible way to study the concept of SGPO 
in repeated quantum games. 


In the standard set-ups to play a quantum game a measure of entanglement for a qubit 
system is introduced. Quantum version of the game reduces to classical when the measure 
becomes zero, We suggested a set-up that exploits another resource from quantum physics, 
‘.e. the association of waves with travelling material objects like electrons, We show how 
in this set-up such association of waves can lead to a non-classical equilibrium in the 
Prisoners’ Dilemma. With associating wavelength approaching zero the quantum aspect 
disappears and the classical game is reproduced. 


10. Playing a symmetric bi-matrix game is usually physical implemented by sharing pairs 
of ‘objects’ between two players. We proposed a new setting that explicitly shows the 
effects of quantum correlations between the pairs on the structure of payoff relations 
and ‘solutions’ of the game. The setting is based on a re-expression of the game such 
that the players play the classical game only if their moves are performed on pairs of 
‘objects having correlations that satisfy the Bell's inequalities. On players receiving pairs 
with quantum correlations the resulting game cannot be considered another classical 
symmetric bi-matrix game. Also the Nash equilibria of the game are found to be decided 
by the nature of the correlations. 
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